Aug 08 23:18:18 user nova-compute[72405]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 08 23:18:21 user nova-compute[72405]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72405) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72405) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72405) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 08 23:18:21 user nova-compute[72405]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:18:21 user nova-compute[72405]: INFO nova.virt.driver [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 08 23:18:21 user nova-compute[72405]: INFO nova.compute.provider_config [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Acquiring lock "singleton_lock" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Acquired lock "singleton_lock" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Releasing lock "singleton_lock" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Full set of CONF: {{(pid=72405) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ******************************************************************************** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Configuration options gathered from: {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ================================================================================ {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] allow_resize_to_same_host      = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] arq_binding_timeout            = 300 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] backdoor_port                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] backdoor_socket                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] block_device_allocate_retries  = 300 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] block_device_allocate_retries_interval = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cert                           = self.pem {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute_monitors               = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] config_dir                     = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] config_drive_format            = iso9660 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] config_source                  = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] console_host                   = user {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] control_exchange               = nova {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cpu_allocation_ratio           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] daemon                         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] debug                          = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] default_access_ip_network_name = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] default_availability_zone      = nova {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] default_ephemeral_format       = ext4 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] default_schedule_zone          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] disk_allocation_ratio          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] enable_new_services            = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] enabled_apis                   = ['osapi_compute'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] enabled_ssl_apis               = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] flat_injected                  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] force_config_drive             = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] force_raw_images               = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] graceful_shutdown_timeout      = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] heal_instance_info_cache_interval = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] host                           = user {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_build_timeout         = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_delete_interval       = 300 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_format                = [instance: %(uuid)s]  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_name_template         = instance-%08x {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_usage_audit           = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_usage_audit_period    = month {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] internal_service_availability_zone = internal {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] key                            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] live_migration_retry_count     = 30 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_config_append              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_dir                        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_file                       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_options                    = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_rotate_interval            = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_rotate_interval_type       = days {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] log_rotation_type              = none {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] long_rpc_timeout               = 1800 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] max_concurrent_builds          = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] max_concurrent_live_migrations = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] max_concurrent_snapshots       = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] max_local_block_devices        = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] max_logfile_count              = 30 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] max_logfile_size_mb            = 200 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] maximum_instance_delete_attempts = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metadata_listen                = 0.0.0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metadata_listen_port           = 8775 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metadata_workers               = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] migrate_max_retries            = -1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] mkisofs_cmd                    = genisoimage {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] my_ip                          = 10.0.0.210 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] network_allocate_retries       = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] osapi_compute_listen_port      = 8774 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] osapi_compute_unique_server_name_scope =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] osapi_compute_workers          = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] password_length                = 12 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] periodic_enable                = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] periodic_fuzzy_delay           = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] pointer_model                  = ps2mouse {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] preallocate_images             = none {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] publish_errors                 = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] pybasedir                      = /opt/stack/nova {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ram_allocation_ratio           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rate_limit_burst               = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rate_limit_except_level        = CRITICAL {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rate_limit_interval            = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reboot_timeout                 = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reclaim_instance_interval      = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] record                         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reimage_timeout_per_gb         = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] report_interval                = 120 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rescue_timeout                 = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reserved_host_cpus             = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reserved_host_disk_mb          = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reserved_host_memory_mb        = 512 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] reserved_huge_pages            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] resize_confirm_window          = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] resize_fs_using_block_device   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] resume_guests_state_on_host_boot = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rpc_response_timeout           = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] run_external_periodic_tasks    = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] running_deleted_instance_action = reap {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] running_deleted_instance_poll_interval = 1800 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] running_deleted_instance_timeout = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler_instance_sync_interval = 120 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_down_time              = 720 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] servicegroup_driver            = db {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] shelved_offload_time           = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] shelved_poll_interval          = 3600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] shutdown_timeout               = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] source_is_ipv6                 = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ssl_only                       = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] state_path                     = /opt/stack/data/nova {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] sync_power_state_interval      = 600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] sync_power_state_pool_size     = 1000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] syslog_log_facility            = LOG_USER {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] tempdir                        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] timeout_nbd                    = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] transport_url                  = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] update_resources_interval      = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_cow_images                 = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_eventlog                   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_journal                    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_json                       = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_rootwrap_daemon            = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_stderr                     = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] use_syslog                     = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vcpu_pin_set                   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plugging_is_fatal          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plugging_timeout           = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] virt_mkfs                      = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] volume_usage_poll_interval     = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] watch_log_file                 = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] web                            = /usr/share/spice-html5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_concurrency.disable_process_locking = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.auth_strategy              = keystone {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.compute_link_prefix        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.dhcp_domain                = novalocal {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.enable_instance_password   = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.glance_link_prefix         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.instance_list_per_project_cells = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.list_records_by_skipping_down_cells = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.local_metadata_per_cell    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.max_limit                  = 1000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.metadata_cache_expiration  = 15 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.neutron_default_tenant_id  = default {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.use_forwarded_for          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.use_neutron_default_nets   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_dynamic_targets = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_jsonfile_path   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.backend                  = dogpile.cache.memcached {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.backend_argument         = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.config_prefix            = cache.oslo {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.dead_timeout             = 60.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.debug_cache_backend      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.enable_retry_client      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.enable_socket_keepalive  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.enabled                  = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.expiration_time          = 600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.hashclient_retry_attempts = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_dead_retry      = 300 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_password        =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_pool_maxsize    = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_sasl_enabled    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.memcache_username        =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.proxies                  = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.retry_attempts           = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.retry_delay              = 0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.socket_keepalive_count   = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.socket_keepalive_idle    = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.socket_keepalive_interval = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.tls_allowed_ciphers      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.tls_cafile               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.tls_certfile             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.tls_enabled              = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cache.tls_keyfile              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.auth_section            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.auth_type               = password {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.cafile                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.certfile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.collect_timing          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.cross_az_attach         = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.debug                   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.endpoint_template       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.http_retries            = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.insecure                = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.keyfile                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.os_region_name          = RegionOne {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.split_loggers           = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cinder.timeout                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.cpu_dedicated_set      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.cpu_shared_set         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.image_type_exclude_list = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.max_concurrent_disk_ops = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.max_disk_devices_to_attach = -1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.resource_provider_association_refresh = 300 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.shutdown_retry_interval = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] conductor.workers              = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] console.allowed_origins        = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] console.ssl_ciphers            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] console.ssl_minimum_version    = default {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] consoleauth.token_ttl          = 600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.cafile                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.certfile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.collect_timing          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.connect_retries         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.connect_retry_delay     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.endpoint_override       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.insecure                = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.keyfile                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.max_version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.min_version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.region_name             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.service_name            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.service_type            = accelerator {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.split_loggers           = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.status_code_retries     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.timeout                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] cyborg.version                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.backend               = sqlalchemy {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.connection            = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.connection_debug      = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.connection_parameters =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.connection_recycle_time = 3600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.connection_trace      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.db_inc_retry_interval = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.db_max_retries        = 20 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.db_max_retry_interval = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.db_retry_interval     = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.max_overflow          = 50 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.max_pool_size         = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.max_retries           = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.mysql_enable_ndb      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.mysql_wsrep_sync_wait = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.pool_timeout          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.retry_interval        = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.slave_connection      = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] database.sqlite_synchronous    = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.backend           = sqlalchemy {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.connection        = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.connection_debug  = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.connection_parameters =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.connection_recycle_time = 3600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.connection_trace  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.db_inc_retry_interval = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.db_max_retries    = 20 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.db_max_retry_interval = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.db_retry_interval = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.max_overflow      = 50 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.max_pool_size     = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.max_retries       = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.mysql_enable_ndb  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.pool_timeout      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.retry_interval    = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.slave_connection  = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] api_database.sqlite_synchronous = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] devices.enabled_mdev_types     = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ephemeral_storage_encryption.enabled = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.api_servers             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.cafile                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.certfile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.collect_timing          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.connect_retries         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.connect_retry_delay     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.debug                   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.default_trusted_certificate_ids = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.enable_certificate_validation = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.enable_rbd_download     = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.endpoint_override       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.insecure                = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.keyfile                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.max_version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.min_version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.num_retries             = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.rbd_ceph_conf           =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.rbd_connect_timeout     = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.rbd_pool                =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.rbd_user                =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.region_name             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.service_name            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.service_type            = image {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.split_loggers           = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.status_code_retries     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.timeout                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.verify_glance_signatures = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] glance.version                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] guestfs.debug                  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.config_drive_cdrom      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.config_drive_inject_password = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.enable_instance_metrics_collection = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.enable_remotefx         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.instances_path_share    =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.iscsi_initiator_list    = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.limit_cpu_features      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.power_state_check_timeframe = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.use_multipath_io        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.volume_attach_retry_count = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.vswitch_name            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] mks.enabled                    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] image_cache.manager_interval   = 2400 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] image_cache.precache_concurrency = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] image_cache.remove_unused_base_images = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] image_cache.subdirectory_name  = _base {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.api_max_retries         = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.api_retry_interval      = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.auth_section            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.auth_type               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.cafile                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.certfile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.collect_timing          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.connect_retries         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.connect_retry_delay     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.endpoint_override       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.insecure                = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.keyfile                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.max_version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.min_version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.partition_key           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.peer_list               = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.region_name             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.serial_console_state_timeout = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.service_name            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.service_type            = baremetal {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.split_loggers           = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.status_code_retries     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.timeout                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ironic.version                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] key_manager.fixed_key          = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.barbican_api_version  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.barbican_endpoint     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.barbican_endpoint_type = public {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.barbican_region_name  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.cafile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.certfile              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.collect_timing        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.insecure              = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.keyfile               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.number_of_retries     = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.retry_delay           = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.send_service_user_token = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.split_loggers         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.timeout               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.verify_ssl            = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican.verify_ssl_path       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.auth_section = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.auth_type = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.cafile   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.certfile = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.collect_timing = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.insecure = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.keyfile  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.split_loggers = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] barbican_service_user.timeout  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.approle_role_id          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.approle_secret_id        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.cafile                   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.certfile                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.collect_timing           = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.insecure                 = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.keyfile                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.kv_mountpoint            = secret {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.kv_version               = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.namespace                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.root_token_id            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.split_loggers            = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.ssl_ca_crt_file          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.timeout                  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.use_ssl                  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.cafile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.certfile              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.collect_timing        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.connect_retries       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.connect_retry_delay   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.endpoint_override     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.insecure              = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.keyfile               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.max_version           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.min_version           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.region_name           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.service_name          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.service_type          = identity {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.split_loggers         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.status_code_retries   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.timeout               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] keystone.version               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.connection_uri         =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:21 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_mode               = custom {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: WARNING oslo_config.cfg [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_power_governor_high = performance {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_power_governor_low = powersave {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_power_management   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.device_detach_attempts = 8 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.device_detach_timeout  = 20 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.disk_cachemodes        = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.disk_prefix            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.enabled_perf_events    = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.file_backed_memory     = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.gid_maps               = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.hw_disk_discard        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.hw_machine_type        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_rbd_glance_store_name =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_rbd_pool        = rbd {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_type            = default {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.images_volume_group    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.inject_key             = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.inject_partition       = -2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.inject_password        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.iscsi_iface            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.iser_use_multipath     = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_bandwidth = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_downtime = 500 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_inbound_addr = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_permit_post_copy = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_scheme  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_timeout_action = abort {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_tunnelled = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: WARNING oslo_config.cfg [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 08 23:18:22 user nova-compute[72405]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 08 23:18:22 user nova-compute[72405]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 08 23:18:22 user nova-compute[72405]: and ``live_migration_inbound_addr`` respectively.
Aug 08 23:18:22 user nova-compute[72405]: ).  Its value may be silently ignored in the future.
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.live_migration_with_native_tls = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.max_queues             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.nfs_mount_options      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.num_memory_encrypted_guests = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.num_pcie_ports         = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.pmem_namespaces        = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.quobyte_client_cfg     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rbd_secret_uuid        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rbd_user               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.remote_filesystem_transport = ssh {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rescue_image_id        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rescue_kernel_id       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rescue_ramdisk_id      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.rx_queue_size          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.smbfs_mount_options    =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.snapshot_compression   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.snapshot_image_format  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.sparse_logical_volumes = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.swtpm_enabled          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.swtpm_group            = tss {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.swtpm_user             = tss {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.sysinfo_serial         = unique {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.tb_cache_size          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.tx_queue_size          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.uid_maps               = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.use_virtio_for_bridges = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.virt_type              = kvm {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.volume_clear           = zero {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.volume_clear_size      = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.volume_use_multipath   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_cache_path   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.vzstorage_mount_user   = stack {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.auth_section           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.auth_type              = password {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.cafile                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.certfile               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.collect_timing         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.connect_retries        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.connect_retry_delay    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.default_floating_pool  = public {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.endpoint_override      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.extension_sync_interval = 600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.http_retries           = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.insecure               = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.keyfile                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.max_version            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.min_version            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.ovs_bridge             = br-int {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.physnets               = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.region_name            = RegionOne {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.service_metadata_proxy = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.service_name           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.service_type           = network {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.split_loggers          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.status_code_retries    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.timeout                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] neutron.version                = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] notifications.bdms_in_notifications = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] notifications.default_level    = INFO {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] notifications.notification_format = unversioned {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] notifications.notify_on_state_change = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] pci.alias                      = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] pci.device_spec                = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] pci.report_in_placement        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.auth_section         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.auth_type            = password {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.cafile               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.certfile             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.collect_timing       = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.connect_retries      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.connect_retry_delay  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.default_domain_id    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.default_domain_name  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.domain_id            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.domain_name          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.endpoint_override    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.insecure             = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.keyfile              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.max_version          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.min_version          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.password             = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.project_domain_id    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.project_domain_name  = Default {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.project_id           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.project_name         = service {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.region_name          = RegionOne {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.service_name         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.service_type         = placement {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.split_loggers        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.status_code_retries  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.system_scope         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.timeout              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.trust_id             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.user_domain_id       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.user_domain_name     = Default {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.user_id              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.username             = placement {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] placement.version              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.cores                    = 20 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.count_usage_from_placement = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.injected_file_content_bytes = 10240 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.injected_file_path_length = 255 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.injected_files           = 5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.instances                = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.key_pairs                = 100 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.metadata_items           = 128 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.ram                      = 51200 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.recheck_quota            = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.server_group_members     = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] quota.server_groups            = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rdp.enabled                    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.image_metadata_prefilter = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.max_attempts         = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.max_placement_results = 1000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.query_placement_for_availability_zone = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.query_placement_for_image_type_support = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] scheduler.workers              = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.host_subset_size = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.isolated_hosts = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.isolated_images = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.pci_in_placement = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.track_instance_changes = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metrics.required               = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metrics.weight_multiplier      = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] metrics.weight_setting         = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] serial_console.enabled         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] serial_console.port_range      = 10000:20000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] serial_console.serialproxy_port = 6083 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.auth_section      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.auth_type         = password {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.cafile            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.certfile          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.collect_timing    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.insecure          = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.keyfile           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.send_service_user_token = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.split_loggers     = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] service_user.timeout           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.agent_enabled            = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.enabled                  = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.html5proxy_port          = 6082 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.image_compression        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.jpeg_compression         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.playback_compression     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.server_listen            = 127.0.0.1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.streaming_mode           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] spice.zlib_compression         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] upgrade_levels.baseapi         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] upgrade_levels.cert            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] upgrade_levels.compute         = auto {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] upgrade_levels.conductor       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] upgrade_levels.scheduler       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.auth_section = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.auth_type = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.cafile = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.certfile = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.insecure = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.keyfile = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vendordata_dynamic_auth.timeout = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.api_retry_count         = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.ca_file                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.cache_prefix            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.cluster_name            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.connection_pool_size    = 10 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.console_delay_seconds   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.datastore_regex         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.host_ip                 = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.host_password           = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.host_port               = 443 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.host_username           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.insecure                = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.integration_bridge      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.maximum_objects         = 100 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.pbm_default_policy      = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.pbm_enabled             = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.pbm_wsdl_location       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.serial_port_proxy_uri   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.serial_port_service_uri = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.task_poll_interval      = 0.5 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.use_linked_clone        = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.vnc_keymap              = en-us {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.vnc_port                = 5900 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vmware.vnc_port_total          = 10000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.auth_schemes               = ['none'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.enabled                    = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.novncproxy_port            = 6080 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.server_listen              = 0.0.0.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.vencrypt_ca_certs          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.vencrypt_client_cert       = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vnc.vencrypt_client_key        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.disable_rootwrap   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.enable_numa_live_migration = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.libvirt_disable_apic = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.client_socket_timeout     = 900 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.default_pool_size         = 1000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.keep_alive                = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.max_header_line           = 16384 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.ssl_ca_file               = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.ssl_cert_file             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.ssl_key_file              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.tcp_keepidle              = 600 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] zvm.ca_file                    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] zvm.cloud_connector_url        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] zvm.reachable_timeout          = 300 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.enforce_new_defaults = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.enforce_scope      = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.policy_default_rule = default {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.policy_file        = policy.yaml {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.connection_string     = messaging:// {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.enabled               = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.es_doc_type           = notification {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.es_scroll_size        = 10000 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.es_scroll_time        = 2m {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.filter_error_trace    = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.hmac_keys             = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.sentinel_service_name = mymaster {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.socket_timeout        = 0.1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.trace_requests        = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler.trace_sqlalchemy      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler_jaeger.process_tags   = {} {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler_jaeger.service_name_prefix = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] profiler_otlp.service_name_prefix = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] remote_debug.host              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] remote_debug.port              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.ssl      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_notifications.retry = -1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.auth_section        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.auth_type           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.cafile              = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.certfile            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.collect_timing      = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.connect_retries     = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.connect_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.endpoint_id         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.endpoint_override   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.insecure            = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.keyfile             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.max_version         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.min_version         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.region_name         = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.service_name        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.service_type        = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.split_loggers       = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.status_code_retries = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.status_code_retry_delay = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.timeout             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.valid_interfaces    = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_limit.version             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_reports.file_event_handler = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] oslo_reports.log_dir           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_ovs_privileged.group  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] vif_plug_ovs_privileged.user   = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.flat_interface = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_ovs.isolate_vif         = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_vif_ovs.per_port_bridge     = False {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] os_brick.lock_path             = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] privsep_osbrick.capabilities   = [21] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] privsep_osbrick.group          = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] privsep_osbrick.helper_command = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] privsep_osbrick.user           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] nova_sys_admin.group           = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] nova_sys_admin.helper_command  = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] nova_sys_admin.user            = None {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG oslo_service.service [None req-b2f9b820-6261-4d5b-b180-db2cd2be08eb None None] ******************************************************************************** {{(pid=72405) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 08 23:18:22 user nova-compute[72405]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Starting native event thread {{(pid=72405) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Starting green dispatch thread {{(pid=72405) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Starting connection event dispatch thread {{(pid=72405) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Connecting to libvirt: qemu:///system {{(pid=72405) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdb9fbfcac0> {{(pid=72405) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdb9fbfcac0> {{(pid=72405) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 08 23:18:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Connection event '1' reason 'None'
Aug 08 23:18:22 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 08 23:18:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.mount [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Initialising _HostMountState generation 0 {{(pid=72405) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 08 23:18:29 user nova-compute[72405]: INFO nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host capabilities <capabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <host>
Aug 08 23:18:29 user nova-compute[72405]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 08 23:18:29 user nova-compute[72405]:     <cpu>
Aug 08 23:18:29 user nova-compute[72405]:       <arch>x86_64</arch>
Aug 08 23:18:29 user nova-compute[72405]:       <model>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <microcode version='1070'/>
Aug 08 23:18:29 user nova-compute[72405]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='osxsave'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='invtsc'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='rsba'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature name='skip-l1dfl-vmentry'/>
Aug 08 23:18:29 user nova-compute[72405]:       <pages unit='KiB' size='4'/>
Aug 08 23:18:29 user nova-compute[72405]:       <pages unit='KiB' size='2048'/>
Aug 08 23:18:29 user nova-compute[72405]:     </cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <power_management>
Aug 08 23:18:29 user nova-compute[72405]:       <suspend_mem/>
Aug 08 23:18:29 user nova-compute[72405]:       <suspend_disk/>
Aug 08 23:18:29 user nova-compute[72405]:       <suspend_hybrid/>
Aug 08 23:18:29 user nova-compute[72405]:     </power_management>
Aug 08 23:18:29 user nova-compute[72405]:     <iommu support='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <migration_features>
Aug 08 23:18:29 user nova-compute[72405]:       <live/>
Aug 08 23:18:29 user nova-compute[72405]:       <uri_transports>
Aug 08 23:18:29 user nova-compute[72405]:         <uri_transport>tcp</uri_transport>
Aug 08 23:18:29 user nova-compute[72405]:         <uri_transport>rdma</uri_transport>
Aug 08 23:18:29 user nova-compute[72405]:       </uri_transports>
Aug 08 23:18:29 user nova-compute[72405]:     </migration_features>
Aug 08 23:18:29 user nova-compute[72405]:     <topology>
Aug 08 23:18:29 user nova-compute[72405]:       <cells num='2'>
Aug 08 23:18:29 user nova-compute[72405]:         <cell id='0'>
Aug 08 23:18:29 user nova-compute[72405]:           <memory unit='KiB'>8189224</memory>
Aug 08 23:18:29 user nova-compute[72405]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 08 23:18:29 user nova-compute[72405]:           <pages unit='KiB' size='2048'>0</pages>
Aug 08 23:18:29 user nova-compute[72405]:           <distances>
Aug 08 23:18:29 user nova-compute[72405]:             <sibling id='0' value='10'/>
Aug 08 23:18:29 user nova-compute[72405]:             <sibling id='1' value='20'/>
Aug 08 23:18:29 user nova-compute[72405]:           </distances>
Aug 08 23:18:29 user nova-compute[72405]:           <cpus num='6'>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 08 23:18:29 user nova-compute[72405]:           </cpus>
Aug 08 23:18:29 user nova-compute[72405]:         </cell>
Aug 08 23:18:29 user nova-compute[72405]:         <cell id='1'>
Aug 08 23:18:29 user nova-compute[72405]:           <memory unit='KiB'>8206460</memory>
Aug 08 23:18:29 user nova-compute[72405]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 08 23:18:29 user nova-compute[72405]:           <pages unit='KiB' size='2048'>0</pages>
Aug 08 23:18:29 user nova-compute[72405]:           <distances>
Aug 08 23:18:29 user nova-compute[72405]:             <sibling id='0' value='20'/>
Aug 08 23:18:29 user nova-compute[72405]:             <sibling id='1' value='10'/>
Aug 08 23:18:29 user nova-compute[72405]:           </distances>
Aug 08 23:18:29 user nova-compute[72405]:           <cpus num='6'>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 08 23:18:29 user nova-compute[72405]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 08 23:18:29 user nova-compute[72405]:           </cpus>
Aug 08 23:18:29 user nova-compute[72405]:         </cell>
Aug 08 23:18:29 user nova-compute[72405]:       </cells>
Aug 08 23:18:29 user nova-compute[72405]:     </topology>
Aug 08 23:18:29 user nova-compute[72405]:     <cache>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 08 23:18:29 user nova-compute[72405]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 08 23:18:29 user nova-compute[72405]:     </cache>
Aug 08 23:18:29 user nova-compute[72405]:     <secmodel>
Aug 08 23:18:29 user nova-compute[72405]:       <model>apparmor</model>
Aug 08 23:18:29 user nova-compute[72405]:       <doi>0</doi>
Aug 08 23:18:29 user nova-compute[72405]:     </secmodel>
Aug 08 23:18:29 user nova-compute[72405]:     <secmodel>
Aug 08 23:18:29 user nova-compute[72405]:       <model>dac</model>
Aug 08 23:18:29 user nova-compute[72405]:       <doi>0</doi>
Aug 08 23:18:29 user nova-compute[72405]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 08 23:18:29 user nova-compute[72405]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 08 23:18:29 user nova-compute[72405]:     </secmodel>
Aug 08 23:18:29 user nova-compute[72405]:   </host>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='alpha'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>clipper</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='armv6l'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>integratorcp</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>borzoi</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>spitz</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>nuri</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>musca-b1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>versatileab</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>kzm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>musca-a</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>smdkc210</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sx1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>z2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>tosa</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>sabrelite</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>realview-eb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>n810</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>n800</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>versatilepb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>terrier</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mainstone</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>midway</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>musicpal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>microbit</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>cubieboard</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>verdex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>netduino2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>raspi2b</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>cheetah</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>highbank</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>akita</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>connex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>collie</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>raspi0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='armv7l'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>integratorcp</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>borzoi</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>spitz</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>nuri</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>musca-b1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>versatileab</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>kzm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>musca-a</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>smdkc210</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sx1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>z2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>tosa</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>sabrelite</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>realview-eb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>n810</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>n800</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>versatilepb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>terrier</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mainstone</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>midway</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>musicpal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>microbit</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>cubieboard</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>verdex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>netduino2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>raspi2b</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>cheetah</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>highbank</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>akita</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>connex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>collie</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>raspi0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='aarch64'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>integratorcp</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>borzoi</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>spitz</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>nuri</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>musca-b1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>versatileab</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>kzm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>musca-a</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>smdkc210</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sx1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>z2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>tosa</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>sabrelite</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>realview-eb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>n810</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>n800</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>versatilepb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>terrier</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mainstone</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>midway</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>musicpal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>microbit</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>cubieboard</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>verdex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>netduino2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>raspi3b</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>raspi2b</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>cheetah</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>highbank</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>akita</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>connex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>collie</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>raspi0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <acpi default='on' toggle='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='cris'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='i686'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>x-remote</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>isapc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>microvm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='kvm'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <pae/>
Aug 08 23:18:29 user nova-compute[72405]:       <nonpae/>
Aug 08 23:18:29 user nova-compute[72405]:       <acpi default='on' toggle='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:       <apic default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='m68k'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>an5206</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>q800</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>next-cube</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='microblaze'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='microblazeel'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='mips'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='16'>malta</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mipssim</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='mipsel'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='16'>malta</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mipssim</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='mips64'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='16'>malta</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mipssim</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>pica61</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>magnum</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='mips64el'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='16'>malta</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mipssim</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>pica61</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>magnum</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='16'>boston</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='ppc'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>g3beige</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mac99</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ppce500</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>pegasos2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sam460ex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>bamboo</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>40p</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>ref405ep</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>taihu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='ppc64'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2048'>powernv9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>taihu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2048'>powernv10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ppce500</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>40p</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>pegasos2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>bamboo</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>g3beige</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mac99</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sam460ex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>ref405ep</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2048'>powernv8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='ppc64le'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2048'>powernv9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>taihu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2048'>powernv10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ppce500</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>40p</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>pegasos2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>bamboo</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>g3beige</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>mac99</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sam460ex</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>ref405ep</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2048'>powernv8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='riscv32'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='8'>spike</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>opentitan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='5'>sifive_u</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sifive_e</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='8'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='riscv64'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='8'>spike</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='5'>sifive_u</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>shakti_c</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sifive_e</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='8'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='s390x'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='sh4'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>shix</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>r2d</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='sh4eb'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>shix</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>r2d</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='sparc'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>SS-5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>SS-20</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>LX</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>SS-4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>SS-10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>Voyager</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='sparc64'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sun4u</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>niagara</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>sun4v</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='x86_64'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>64</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>x-remote</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='1'>isapc</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>microvm</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='kvm'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <acpi default='on' toggle='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:       <apic default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='xtensa'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>sim</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>kc705</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ml605</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx200</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx60</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]:   <guest>
Aug 08 23:18:29 user nova-compute[72405]:     <os_type>hvm</os_type>
Aug 08 23:18:29 user nova-compute[72405]:     <arch name='xtensaeb'>
Aug 08 23:18:29 user nova-compute[72405]:       <wordsize>32</wordsize>
Aug 08 23:18:29 user nova-compute[72405]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='4'>sim</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>kc705</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ml605</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>virt</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx200</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>lx60</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 08 23:18:29 user nova-compute[72405]:       <domain type='qemu'/>
Aug 08 23:18:29 user nova-compute[72405]:     </arch>
Aug 08 23:18:29 user nova-compute[72405]:     <features>
Aug 08 23:18:29 user nova-compute[72405]:       <cpuselection/>
Aug 08 23:18:29 user nova-compute[72405]:       <deviceboot/>
Aug 08 23:18:29 user nova-compute[72405]:       <disksnapshot default='on' toggle='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     </features>
Aug 08 23:18:29 user nova-compute[72405]:   </guest>
Aug 08 23:18:29 user nova-compute[72405]: </capabilities>
Aug 08 23:18:29 user nova-compute[72405]: 
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-i386</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-i440fx-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>i686</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='255'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'/>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='lm'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ide</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-i386</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-i440fx-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>i686</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='255'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'/>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='lm'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ide</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-i386</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-q35-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>i686</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='288'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'/>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='lm'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-i386</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-q35-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>i686</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='288'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'/>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='lm'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-i440fx-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>x86_64</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='255'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>efi</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='invtsc'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='rsba'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pschange-mc-no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ide</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-i440fx-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>x86_64</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='255'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>efi</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='invtsc'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='rsba'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pschange-mc-no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ide</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-q35-jammy</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>x86_64</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='288'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>efi</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='invtsc'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='rsba'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pschange-mc-no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 08 23:18:29 user nova-compute[72405]: <domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 08 23:18:29 user nova-compute[72405]:   <domain>kvm</domain>
Aug 08 23:18:29 user nova-compute[72405]:   <machine>pc-q35-6.2</machine>
Aug 08 23:18:29 user nova-compute[72405]:   <arch>x86_64</arch>
Aug 08 23:18:29 user nova-compute[72405]:   <vcpu max='288'/>
Aug 08 23:18:29 user nova-compute[72405]:   <iothreads supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:   <os supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='firmware'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>efi</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:     <loader supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>rom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pflash</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='readonly'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='secure'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>yes</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>no</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </loader>
Aug 08 23:18:29 user nova-compute[72405]:   </os>
Aug 08 23:18:29 user nova-compute[72405]:   <cpu>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-passthrough' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='hostPassthroughMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='maximum' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='maximumMigratable'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>on</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>off</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='host-model' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <vendor>Intel</vendor>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ss'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='vmx'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pcid'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='hypervisor'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arat'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='tsc_adjust'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='umip'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='md-clear'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='arch-capabilities'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='invtsc'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibpb'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='ibrs'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-stibp'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='amd-ssbd'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='rsba'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='require' name='pschange-mc-no'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='erms'/>
Aug 08 23:18:29 user nova-compute[72405]:       <feature policy='disable' name='xsaveopt'/>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:     <mode name='custom' supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>qemu64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>qemu32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>phenom</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>pentium</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>n270</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm64</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>kvm32</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>coreduo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>core2duo</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>athlon</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Westmere</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Snowridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Skylake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>SandyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Penryn</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G5</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G4</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G3</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Opteron_G2</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Opteron_G1</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>IvyBridge</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Icelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Haswell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Rome</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-Milan</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC-IBPB</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>EPYC</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Dhyana</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cooperlake</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>Conroe</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Cascadelake-Server</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-noTSX</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell-IBRS</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='no'>Broadwell</model>
Aug 08 23:18:29 user nova-compute[72405]:       <model usable='yes'>486</model>
Aug 08 23:18:29 user nova-compute[72405]:     </mode>
Aug 08 23:18:29 user nova-compute[72405]:   </cpu>
Aug 08 23:18:29 user nova-compute[72405]:   <memoryBacking supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:     <enum name='sourceType'>
Aug 08 23:18:29 user nova-compute[72405]:       <value>file</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>anonymous</value>
Aug 08 23:18:29 user nova-compute[72405]:       <value>memfd</value>
Aug 08 23:18:29 user nova-compute[72405]:     </enum>
Aug 08 23:18:29 user nova-compute[72405]:   </memoryBacking>
Aug 08 23:18:29 user nova-compute[72405]:   <devices>
Aug 08 23:18:29 user nova-compute[72405]:     <disk supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='diskDevice'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>disk</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cdrom</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>floppy</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>lun</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='bus'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>fdc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sata</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </disk>
Aug 08 23:18:29 user nova-compute[72405]:     <graphics supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='type'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>sdl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vnc</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>spice</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egl-headless</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </graphics>
Aug 08 23:18:29 user nova-compute[72405]:     <video supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='modelType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>cirrus</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>vmvga</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>qxl</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>none</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>bochs</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>ramfb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </video>
Aug 08 23:18:29 user nova-compute[72405]:     <hostdev supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='mode'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>subsystem</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='startupPolicy'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>default</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>mandatory</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>requisite</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>optional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='subsysType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>usb</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>pci</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>scsi</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='capsType'/>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='pciBackend'/>
Aug 08 23:18:29 user nova-compute[72405]:     </hostdev>
Aug 08 23:18:29 user nova-compute[72405]:     <rng supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtio-non-transitional</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>random</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>egd</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>builtin</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </rng>
Aug 08 23:18:29 user nova-compute[72405]:     <filesystem supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='driverType'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>path</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>handle</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>virtiofs</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </filesystem>
Aug 08 23:18:29 user nova-compute[72405]:     <tpm supported='yes'>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='model'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-tis</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>tpm-crb</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:       <enum name='backendModel'>
Aug 08 23:18:29 user nova-compute[72405]:         <value>passthrough</value>
Aug 08 23:18:29 user nova-compute[72405]:         <value>emulator</value>
Aug 08 23:18:29 user nova-compute[72405]:       </enum>
Aug 08 23:18:29 user nova-compute[72405]:     </tpm>
Aug 08 23:18:29 user nova-compute[72405]:   </devices>
Aug 08 23:18:29 user nova-compute[72405]:   <features>
Aug 08 23:18:29 user nova-compute[72405]:     <gic supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:     <vmcoreinfo supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <genid supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backingStoreInput supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <backup supported='yes'/>
Aug 08 23:18:29 user nova-compute[72405]:     <sev supported='no'/>
Aug 08 23:18:29 user nova-compute[72405]:   </features>
Aug 08 23:18:29 user nova-compute[72405]: </domainCapabilities>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72405) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72405) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Checking secure boot support for host arch (x86_64) {{(pid=72405) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Checking secure boot support for host arch (x86_64) {{(pid=72405) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Checking secure boot support for host arch (x86_64) {{(pid=72405) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Checking secure boot support for host arch (x86_64) {{(pid=72405) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Checking secure boot support for host arch (x86_64) {{(pid=72405) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 08 23:18:29 user nova-compute[72405]: INFO nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Secure Boot support detected
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] cpu compare xml: <cpu match="exact">
Aug 08 23:18:29 user nova-compute[72405]:   <model>Nehalem</model>
Aug 08 23:18:29 user nova-compute[72405]: </cpu>
Aug 08 23:18:29 user nova-compute[72405]:  {{(pid=72405) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 08 23:18:29 user nova-compute[72405]: INFO nova.virt.node [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Generated node identity 488a0e0f-53ed-47ef-b1b6-c809d06d6be1
Aug 08 23:18:29 user nova-compute[72405]: INFO nova.virt.node [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Wrote node identity 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 to /opt/stack/data/nova/compute_id
Aug 08 23:18:29 user nova-compute[72405]: WARNING nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Compute nodes ['488a0e0f-53ed-47ef-b1b6-c809d06d6be1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 08 23:18:29 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 08 23:18:29 user nova-compute[72405]: WARNING nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 08 23:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:18:29 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:18:29 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:18:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Hypervisor/Node resource view: name=user free_ram=10870MB free_disk=26.318588256835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:18:29 user nova-compute[72405]: WARNING nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] No compute node record for user:488a0e0f-53ed-47ef-b1b6-c809d06d6be1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 could not be found.
Aug 08 23:18:29 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Compute node record created for user:user with uuid: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:18:30 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [req-488da433-cf8b-44bb-85d5-cfd950f299f8] Created resource provider record via placement API for resource provider with UUID 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 and name user.
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72405) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 08 23:18:30 user nova-compute[72405]: INFO nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] kernel doesn't support AMD SEV
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Libvirt baseline CPU <cpu>
Aug 08 23:18:30 user nova-compute[72405]:   <arch>x86_64</arch>
Aug 08 23:18:30 user nova-compute[72405]:   <model>Nehalem</model>
Aug 08 23:18:30 user nova-compute[72405]:   <vendor>Intel</vendor>
Aug 08 23:18:30 user nova-compute[72405]:   <topology sockets="6" cores="1" threads="1"/>
Aug 08 23:18:30 user nova-compute[72405]: </cpu>
Aug 08 23:18:30 user nova-compute[72405]:  {{(pid=72405) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Updated inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Updating resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 generation from 0 to 1 during operation: update_inventory {{(pid=72405) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Updating resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 generation from 1 to 2 during operation: update_traits {{(pid=72405) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.service [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Creating RPC server for service compute {{(pid=72405) start /opt/stack/nova/nova/service.py:182}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.service [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Join ServiceGroup membership for this service compute {{(pid=72405) start /opt/stack/nova/nova/service.py:199}}
Aug 08 23:18:30 user nova-compute[72405]: DEBUG nova.servicegroup.drivers.db [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72405) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 08 23:19:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:19:21 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:19:21 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=10259MB free_disk=26.222335815429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:19:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:19:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:19:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:20:22 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:20:22 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=10195MB free_disk=26.267597198486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:20:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:20:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:20:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:20:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 08 23:20:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:20:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:21:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:21:23 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:21:23 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=10199MB free_disk=26.04143524169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:21:23 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:21:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:21:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:21:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:22:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:22:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:22:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 08 23:22:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:22:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=9481MB free_disk=26.072479248046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:22:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:22:26 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:22:26 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:22:26 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:22:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:22:34 user nova-compute[72405]: INFO nova.compute.claims [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Claim successful on node user
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.network.neutron [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:22:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:22:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Creating image(s)
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "/opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "/opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "/opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:35 user nova-compute[72405]: DEBUG nova.policy [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ef4cd8a6a5143e2a8b1463d6fca7efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3900313ee6442da973f370f77cf6f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:22:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:35 user nova-compute[72405]: DEBUG nova.virt.images [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] ed72958c-30b3-4e1d-9bb6-9c0404b96321 was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:22:35 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:22:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.part /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.part /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.converted" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.181s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:36 user nova-compute[72405]: INFO oslo.privsep.daemon [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmtieh892/privsep.sock']
Aug 08 23:22:36 user sudo[81534]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmtieh892/privsep.sock
Aug 08 23:22:36 user sudo[81534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 08 23:22:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Successfully created port: ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:22:38 user sudo[81534]: pam_unix(sudo:session): session closed for user root
Aug 08 23:22:38 user nova-compute[72405]: INFO oslo.privsep.daemon [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Spawned new privsep daemon via rootwrap
Aug 08 23:22:38 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 08 23:22:38 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 08 23:22:38 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 08 23:22:38 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81539
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.125s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.123s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk 1073741824" returned: 0 in 0.047s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.128s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:22:38 user nova-compute[72405]: INFO nova.compute.claims [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Claim successful on node user
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Cannot resize image /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lazy-loading 'migration_context' on Instance uuid 1653b9e2-dbff-4620-90d2-b59e612fc3f4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Ensure instance console log exists: /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:22:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:22:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Creating image(s)
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "/opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.policy [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9b5279220af4cc4a364014419168ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf26de781ef4462914d7f32168b3192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.128s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.115s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk 1073741824" returned: 0 in 0.050s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.119s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:22:39 user nova-compute[72405]: INFO nova.compute.claims [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Claim successful on node user
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Cannot resize image /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.objects.instance [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'migration_context' on Instance uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Ensure instance console log exists: /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Successfully updated port: ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquired lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:22:39 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:22:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:22:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Creating image(s)
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-changed-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Refreshing instance network info cache due to event network-changed-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] Acquiring lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.policy [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e934b55e46634b7097bb144b74ac5954', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ebca86ade54e1f9805255b64901be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.129s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk 1073741824" returned: 0 in 0.125s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:22:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Successfully created port: 9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Cannot resize image /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'migration_context' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Ensure instance console log exists: /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updating instance_info_cache with network_info: [{"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Releasing lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Instance network_info: |[{"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] Acquired lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Refreshing network info cache for port ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Start _get_guest_xml network_info=[{"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:22:41 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:41 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-883556648',display_name='tempest-DeleteServersTestJSON-server-883556648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-883556648',id=1,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3900313ee6442da973f370f77cf6f14',ramdisk_id='',reservation_id='r-kg2jnej9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1797086066',owner_user_name='tempest-DeleteServersTestJSON-1797086066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:35Z,user_data=None,user_id='9ef4cd8a6a5143e2a8b1463d6fca7efa',uuid=1653b9e2-dbff-4620-90d2-b59e612fc3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Converting VIF {"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lazy-loading 'pci_devices' on Instance uuid 1653b9e2-dbff-4620-90d2-b59e612fc3f4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:22:41 user nova-compute[72405]:   <uuid>1653b9e2-dbff-4620-90d2-b59e612fc3f4</uuid>
Aug 08 23:22:41 user nova-compute[72405]:   <name>instance-00000001</name>
Aug 08 23:22:41 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:22:41 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:22:41 user nova-compute[72405]:   <metadata>
Aug 08 23:22:41 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:22:41 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:22:41 user nova-compute[72405]:       <nova:name>tempest-DeleteServersTestJSON-server-883556648</nova:name>
Aug 08 23:22:41 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:22:41</nova:creationTime>
Aug 08 23:22:41 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:22:41 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:22:41 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:22:41 user nova-compute[72405]:       <nova:owner>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:user uuid="9ef4cd8a6a5143e2a8b1463d6fca7efa">tempest-DeleteServersTestJSON-1797086066-project-member</nova:user>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:project uuid="e3900313ee6442da973f370f77cf6f14">tempest-DeleteServersTestJSON-1797086066</nova:project>
Aug 08 23:22:41 user nova-compute[72405]:       </nova:owner>
Aug 08 23:22:41 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:22:41 user nova-compute[72405]:       <nova:ports>
Aug 08 23:22:41 user nova-compute[72405]:         <nova:port uuid="ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5">
Aug 08 23:22:41 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:22:41 user nova-compute[72405]:         </nova:port>
Aug 08 23:22:41 user nova-compute[72405]:       </nova:ports>
Aug 08 23:22:41 user nova-compute[72405]:     </nova:instance>
Aug 08 23:22:41 user nova-compute[72405]:   </metadata>
Aug 08 23:22:41 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:22:41 user nova-compute[72405]:     <system>
Aug 08 23:22:41 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:22:41 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:22:41 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:22:41 user nova-compute[72405]:       <entry name="serial">1653b9e2-dbff-4620-90d2-b59e612fc3f4</entry>
Aug 08 23:22:41 user nova-compute[72405]:       <entry name="uuid">1653b9e2-dbff-4620-90d2-b59e612fc3f4</entry>
Aug 08 23:22:41 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:22:41 user nova-compute[72405]:     </system>
Aug 08 23:22:41 user nova-compute[72405]:   </sysinfo>
Aug 08 23:22:41 user nova-compute[72405]:   <os>
Aug 08 23:22:41 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:22:41 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:22:41 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:22:41 user nova-compute[72405]:   </os>
Aug 08 23:22:41 user nova-compute[72405]:   <features>
Aug 08 23:22:41 user nova-compute[72405]:     <acpi/>
Aug 08 23:22:41 user nova-compute[72405]:     <apic/>
Aug 08 23:22:41 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:22:41 user nova-compute[72405]:   </features>
Aug 08 23:22:41 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:22:41 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:22:41 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:22:41 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:22:41 user nova-compute[72405]:   </clock>
Aug 08 23:22:41 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:22:41 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:22:41 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:22:41 user nova-compute[72405]:   </cpu>
Aug 08 23:22:41 user nova-compute[72405]:   <devices>
Aug 08 23:22:41 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:22:41 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:22:41 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk"/>
Aug 08 23:22:41 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:22:41 user nova-compute[72405]:     </disk>
Aug 08 23:22:41 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:22:41 user nova-compute[72405]:       <mac address="fa:16:3e:d9:5f:12"/>
Aug 08 23:22:41 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:41 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:22:41 user nova-compute[72405]:       <target dev="tapab6e3a7e-ef"/>
Aug 08 23:22:41 user nova-compute[72405]:     </interface>
Aug 08 23:22:41 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:22:41 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/console.log" append="off"/>
Aug 08 23:22:41 user nova-compute[72405]:     </serial>
Aug 08 23:22:41 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:22:41 user nova-compute[72405]:     <video>
Aug 08 23:22:41 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:41 user nova-compute[72405]:     </video>
Aug 08 23:22:41 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:22:41 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:22:41 user nova-compute[72405]:     </rng>
Aug 08 23:22:41 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:22:41 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:22:41 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:22:41 user nova-compute[72405]:     </memballoon>
Aug 08 23:22:41 user nova-compute[72405]:   </devices>
Aug 08 23:22:41 user nova-compute[72405]: </domain>
Aug 08 23:22:41 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-883556648',display_name='tempest-DeleteServersTestJSON-server-883556648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-883556648',id=1,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3900313ee6442da973f370f77cf6f14',ramdisk_id='',reservation_id='r-kg2jnej9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1797086066',owner_user_name='tempest-DeleteServersTestJSON-1797086066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:35Z,user_data=None,user_id='9ef4cd8a6a5143e2a8b1463d6fca7efa',uuid=1653b9e2-dbff-4620-90d2-b59e612fc3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Converting VIF {"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG os_vif [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Created schema index Interface.name {{(pid=72405) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Created schema index Port.name {{(pid=72405) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Created schema index Bridge.name {{(pid=72405) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [POLLOUT] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:22:41 user nova-compute[72405]: INFO oslo.privsep.daemon [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyx342ub5/privsep.sock']
Aug 08 23:22:41 user sudo[81605]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyx342ub5/privsep.sock
Aug 08 23:22:41 user sudo[81605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:43 user sudo[81605]: pam_unix(sudo:session): session closed for user root
Aug 08 23:22:43 user nova-compute[72405]: INFO oslo.privsep.daemon [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Spawned new privsep daemon via rootwrap
Aug 08 23:22:43 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 08 23:22:43 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 08 23:22:43 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 08 23:22:43 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81608
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Successfully updated port: 9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-changed-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Refreshing instance network info cache due to event network-changed-9e92c8b8-06aa-4479-9b39-3e9e17109492. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] Acquiring lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab6e3a7e-ef, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab6e3a7e-ef, col_values=(('external_ids', {'iface-id': 'ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5f:12', 'vm-uuid': '1653b9e2-dbff-4620-90d2-b59e612fc3f4'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:43 user nova-compute[72405]: INFO os_vif [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef')
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:22:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] No VIF found with MAC fa:16:3e:d9:5f:12, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Instance network_info: |[{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] Acquired lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Refreshing network info cache for port 9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Start _get_guest_xml network_info=[{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:22:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1671331769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1671331769',id=2,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-00ofaqet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:39Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=0842ac6f-7cac-475c-8a15-d580922ce739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'pci_devices' on Instance uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updated VIF entry in instance network info cache for port ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updating instance_info_cache with network_info: [{"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:22:44 user nova-compute[72405]:   <uuid>0842ac6f-7cac-475c-8a15-d580922ce739</uuid>
Aug 08 23:22:44 user nova-compute[72405]:   <name>instance-00000002</name>
Aug 08 23:22:44 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:22:44 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:22:44 user nova-compute[72405]:   <metadata>
Aug 08 23:22:44 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:22:44 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:22:44 user nova-compute[72405]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1671331769</nova:name>
Aug 08 23:22:44 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:22:44</nova:creationTime>
Aug 08 23:22:44 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:22:44 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:22:44 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:22:44 user nova-compute[72405]:       <nova:owner>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:user uuid="d9b5279220af4cc4a364014419168ae8">tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member</nova:user>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:project uuid="1bf26de781ef4462914d7f32168b3192">tempest-ServerBootFromVolumeStableRescueTest-1549652719</nova:project>
Aug 08 23:22:44 user nova-compute[72405]:       </nova:owner>
Aug 08 23:22:44 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:22:44 user nova-compute[72405]:       <nova:ports>
Aug 08 23:22:44 user nova-compute[72405]:         <nova:port uuid="9e92c8b8-06aa-4479-9b39-3e9e17109492">
Aug 08 23:22:44 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 08 23:22:44 user nova-compute[72405]:         </nova:port>
Aug 08 23:22:44 user nova-compute[72405]:       </nova:ports>
Aug 08 23:22:44 user nova-compute[72405]:     </nova:instance>
Aug 08 23:22:44 user nova-compute[72405]:   </metadata>
Aug 08 23:22:44 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:22:44 user nova-compute[72405]:     <system>
Aug 08 23:22:44 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:22:44 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:22:44 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:22:44 user nova-compute[72405]:       <entry name="serial">0842ac6f-7cac-475c-8a15-d580922ce739</entry>
Aug 08 23:22:44 user nova-compute[72405]:       <entry name="uuid">0842ac6f-7cac-475c-8a15-d580922ce739</entry>
Aug 08 23:22:44 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:22:44 user nova-compute[72405]:     </system>
Aug 08 23:22:44 user nova-compute[72405]:   </sysinfo>
Aug 08 23:22:44 user nova-compute[72405]:   <os>
Aug 08 23:22:44 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:22:44 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:22:44 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:22:44 user nova-compute[72405]:   </os>
Aug 08 23:22:44 user nova-compute[72405]:   <features>
Aug 08 23:22:44 user nova-compute[72405]:     <acpi/>
Aug 08 23:22:44 user nova-compute[72405]:     <apic/>
Aug 08 23:22:44 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:22:44 user nova-compute[72405]:   </features>
Aug 08 23:22:44 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:22:44 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:22:44 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:22:44 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:22:44 user nova-compute[72405]:   </clock>
Aug 08 23:22:44 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:22:44 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:22:44 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:22:44 user nova-compute[72405]:   </cpu>
Aug 08 23:22:44 user nova-compute[72405]:   <devices>
Aug 08 23:22:44 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:22:44 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:22:44 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk"/>
Aug 08 23:22:44 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:22:44 user nova-compute[72405]:     </disk>
Aug 08 23:22:44 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:22:44 user nova-compute[72405]:       <mac address="fa:16:3e:a5:2c:90"/>
Aug 08 23:22:44 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:44 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:22:44 user nova-compute[72405]:       <target dev="tap9e92c8b8-06"/>
Aug 08 23:22:44 user nova-compute[72405]:     </interface>
Aug 08 23:22:44 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:22:44 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/console.log" append="off"/>
Aug 08 23:22:44 user nova-compute[72405]:     </serial>
Aug 08 23:22:44 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:22:44 user nova-compute[72405]:     <video>
Aug 08 23:22:44 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:44 user nova-compute[72405]:     </video>
Aug 08 23:22:44 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:22:44 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:22:44 user nova-compute[72405]:     </rng>
Aug 08 23:22:44 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:22:44 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:22:44 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:22:44 user nova-compute[72405]:     </memballoon>
Aug 08 23:22:44 user nova-compute[72405]:   </devices>
Aug 08 23:22:44 user nova-compute[72405]: </domain>
Aug 08 23:22:44 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1671331769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1671331769',id=2,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-00ofaqet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:39Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=0842ac6f-7cac-475c-8a15-d580922ce739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG os_vif [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4357b74d-cdf6-40c8-9a0a-d5a8f43e813c req-271a25d4-5710-4202-a71d-91d88852af07 service nova] Releasing lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e92c8b8-06, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e92c8b8-06, col_values=(('external_ids', {'iface-id': '9e92c8b8-06aa-4479-9b39-3e9e17109492', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:2c:90', 'vm-uuid': '0842ac6f-7cac-475c-8a15-d580922ce739'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:44 user nova-compute[72405]: INFO os_vif [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06')
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No VIF found with MAC fa:16:3e:a5:2c:90, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:22:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Successfully created port: 8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:22:45 user nova-compute[72405]: INFO nova.compute.claims [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Claim successful on node user
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-77d17c70-ca3e-439c-be9b-5987a803367a req-27688791-8871-45b9-8e0a-bdcb61b4f8c8 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-77d17c70-ca3e-439c-be9b-5987a803367a req-27688791-8871-45b9-8e0a-bdcb61b4f8c8 service nova] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-77d17c70-ca3e-439c-be9b-5987a803367a req-27688791-8871-45b9-8e0a-bdcb61b4f8c8 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-77d17c70-ca3e-439c-be9b-5987a803367a req-27688791-8871-45b9-8e0a-bdcb61b4f8c8 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-77d17c70-ca3e-439c-be9b-5987a803367a req-27688791-8871-45b9-8e0a-bdcb61b4f8c8 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] No waiting events found dispatching network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:45 user nova-compute[72405]: WARNING nova.compute.manager [req-77d17c70-ca3e-439c-be9b-5987a803367a req-27688791-8871-45b9-8e0a-bdcb61b4f8c8 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received unexpected event network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 for instance with vm_state building and task_state spawning.
Aug 08 23:22:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.231s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:22:46 user nova-compute[72405]: INFO nova.compute.claims [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Claim successful on node user
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updated VIF entry in instance network info cache for port 9e92c8b8-06aa-4479-9b39-3e9e17109492. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-77180ecb-f1b5-455a-bc51-92919f78ba67 req-a9a6e71b-e1b9-4994-a89f-d766e5e6f0ab service nova] Releasing lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.network.neutron [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:22:46 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:22:46 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Creating image(s)
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.policy [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8334edbf14ec382f6cd1c426703c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a146c9a0c224249ac3316e931874bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk 1073741824" returned: 0 in 0.044s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:22:46 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:22:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:22:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Creating image(s)
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.policy [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb25719ffe4c467e8afc3f6b8fe4d712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6dc799f1b4698b15a3ea91c8dbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Cannot resize image /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'migration_context' on Instance uuid 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Ensure instance console log exists: /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.117s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk 1073741824" returned: 0 in 0.046s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.119s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Cannot resize image /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'migration_context' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Ensure instance console log exists: /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536967.7363715, 1653b9e2-dbff-4620-90d2-b59e612fc3f4 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:47 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] VM Resumed (Lifecycle Event)
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:22:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Instance spawned successfully.
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-e72eef29-c652-4ec2-8d7b-c6a758112a31 req-99769f02-e724-4c53-b47d-3faecbd5312e service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e72eef29-c652-4ec2-8d7b-c6a758112a31 req-99769f02-e724-4c53-b47d-3faecbd5312e service nova] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e72eef29-c652-4ec2-8d7b-c6a758112a31 req-99769f02-e724-4c53-b47d-3faecbd5312e service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e72eef29-c652-4ec2-8d7b-c6a758112a31 req-99769f02-e724-4c53-b47d-3faecbd5312e service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-e72eef29-c652-4ec2-8d7b-c6a758112a31 req-99769f02-e724-4c53-b47d-3faecbd5312e service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] No waiting events found dispatching network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:47 user nova-compute[72405]: WARNING nova.compute.manager [req-e72eef29-c652-4ec2-8d7b-c6a758112a31 req-99769f02-e724-4c53-b47d-3faecbd5312e service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received unexpected event network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 for instance with vm_state building and task_state spawning.
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:47 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536967.7384515, 1653b9e2-dbff-4620-90d2-b59e612fc3f4 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:47 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] VM Started (Lifecycle Event)
Aug 08 23:22:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:47 user nova-compute[72405]: INFO nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Took 12.98 seconds to spawn the instance on the hypervisor.
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Took 13.79 seconds to build instance.
Aug 08 23:22:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-646df240-fb37-4f46-891f-cc867cd3c962 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.021s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-46d52c1d-a6d6-4f5b-9af6-87ef47036dcd req-9991dabf-39fb-40a4-82f7-c8bb4437c544 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-46d52c1d-a6d6-4f5b-9af6-87ef47036dcd req-9991dabf-39fb-40a4-82f7-c8bb4437c544 service nova] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-46d52c1d-a6d6-4f5b-9af6-87ef47036dcd req-9991dabf-39fb-40a4-82f7-c8bb4437c544 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-46d52c1d-a6d6-4f5b-9af6-87ef47036dcd req-9991dabf-39fb-40a4-82f7-c8bb4437c544 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-46d52c1d-a6d6-4f5b-9af6-87ef47036dcd req-9991dabf-39fb-40a4-82f7-c8bb4437c544 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] No waiting events found dispatching network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:48 user nova-compute[72405]: WARNING nova.compute.manager [req-46d52c1d-a6d6-4f5b-9af6-87ef47036dcd req-9991dabf-39fb-40a4-82f7-c8bb4437c544 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received unexpected event network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 for instance with vm_state active and task_state None.
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536968.631331, 0842ac6f-7cac-475c-8a15-d580922ce739 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] VM Resumed (Lifecycle Event)
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Instance spawned successfully.
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536968.6323097, 0842ac6f-7cac-475c-8a15-d580922ce739 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] VM Started (Lifecycle Event)
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Took 9.64 seconds to spawn the instance on the hypervisor.
Aug 08 23:22:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:48 user nova-compute[72405]: INFO nova.compute.manager [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Took 10.27 seconds to build instance.
Aug 08 23:22:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-842b14ec-d22f-4e70-9596-748e227fa0b2 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.412s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Successfully updated port: 8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-changed-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Refreshing instance network info cache due to event network-changed-8654907e-9844-4cf4-8754-5b540b3aa53c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Successfully created port: 95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-49d74878-cdb4-4bcb-aa56-2d937f51389b req-4e0a6327-bd85-44f0-94aa-a1dc3b17f374 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49d74878-cdb4-4bcb-aa56-2d937f51389b req-4e0a6327-bd85-44f0-94aa-a1dc3b17f374 service nova] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49d74878-cdb4-4bcb-aa56-2d937f51389b req-4e0a6327-bd85-44f0-94aa-a1dc3b17f374 service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49d74878-cdb4-4bcb-aa56-2d937f51389b req-4e0a6327-bd85-44f0-94aa-a1dc3b17f374 service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-49d74878-cdb4-4bcb-aa56-2d937f51389b req-4e0a6327-bd85-44f0-94aa-a1dc3b17f374 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] No waiting events found dispatching network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:49 user nova-compute[72405]: WARNING nova.compute.manager [req-49d74878-cdb4-4bcb-aa56-2d937f51389b req-4e0a6327-bd85-44f0-94aa-a1dc3b17f374 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received unexpected event network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 for instance with vm_state active and task_state None.
Aug 08 23:22:50 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Successfully created port: 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:22:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.network.neutron [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance network_info: |[{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.network.neutron [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Refreshing network info cache for port 8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start _get_guest_xml network_info=[{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:22:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:22:51 user nova-compute[72405]:   <uuid>80e7599c-bd2a-499d-9b2b-4c613f375900</uuid>
Aug 08 23:22:51 user nova-compute[72405]:   <name>instance-00000003</name>
Aug 08 23:22:51 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:22:51 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:22:51 user nova-compute[72405]:   <metadata>
Aug 08 23:22:51 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:22:51 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:22:51 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeTestJSON-server-1585614820</nova:name>
Aug 08 23:22:51 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:22:51</nova:creationTime>
Aug 08 23:22:51 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:22:51 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:22:51 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:22:51 user nova-compute[72405]:       <nova:owner>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:user uuid="e934b55e46634b7097bb144b74ac5954">tempest-AttachVolumeTestJSON-1838616528-project-member</nova:user>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:project uuid="72ebca86ade54e1f9805255b64901be8">tempest-AttachVolumeTestJSON-1838616528</nova:project>
Aug 08 23:22:51 user nova-compute[72405]:       </nova:owner>
Aug 08 23:22:51 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:22:51 user nova-compute[72405]:       <nova:ports>
Aug 08 23:22:51 user nova-compute[72405]:         <nova:port uuid="8654907e-9844-4cf4-8754-5b540b3aa53c">
Aug 08 23:22:51 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:22:51 user nova-compute[72405]:         </nova:port>
Aug 08 23:22:51 user nova-compute[72405]:       </nova:ports>
Aug 08 23:22:51 user nova-compute[72405]:     </nova:instance>
Aug 08 23:22:51 user nova-compute[72405]:   </metadata>
Aug 08 23:22:51 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:22:51 user nova-compute[72405]:     <system>
Aug 08 23:22:51 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:22:51 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:22:51 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:22:51 user nova-compute[72405]:       <entry name="serial">80e7599c-bd2a-499d-9b2b-4c613f375900</entry>
Aug 08 23:22:51 user nova-compute[72405]:       <entry name="uuid">80e7599c-bd2a-499d-9b2b-4c613f375900</entry>
Aug 08 23:22:51 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:22:51 user nova-compute[72405]:     </system>
Aug 08 23:22:51 user nova-compute[72405]:   </sysinfo>
Aug 08 23:22:51 user nova-compute[72405]:   <os>
Aug 08 23:22:51 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:22:51 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:22:51 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:22:51 user nova-compute[72405]:   </os>
Aug 08 23:22:51 user nova-compute[72405]:   <features>
Aug 08 23:22:51 user nova-compute[72405]:     <acpi/>
Aug 08 23:22:51 user nova-compute[72405]:     <apic/>
Aug 08 23:22:51 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:22:51 user nova-compute[72405]:   </features>
Aug 08 23:22:51 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:22:51 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:22:51 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:22:51 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:22:51 user nova-compute[72405]:   </clock>
Aug 08 23:22:51 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:22:51 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:22:51 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:22:51 user nova-compute[72405]:   </cpu>
Aug 08 23:22:51 user nova-compute[72405]:   <devices>
Aug 08 23:22:51 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:22:51 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:22:51 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk"/>
Aug 08 23:22:51 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:22:51 user nova-compute[72405]:     </disk>
Aug 08 23:22:51 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:22:51 user nova-compute[72405]:       <mac address="fa:16:3e:f6:53:af"/>
Aug 08 23:22:51 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:51 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:22:51 user nova-compute[72405]:       <target dev="tap8654907e-98"/>
Aug 08 23:22:51 user nova-compute[72405]:     </interface>
Aug 08 23:22:51 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:22:51 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/console.log" append="off"/>
Aug 08 23:22:51 user nova-compute[72405]:     </serial>
Aug 08 23:22:51 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:22:51 user nova-compute[72405]:     <video>
Aug 08 23:22:51 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:51 user nova-compute[72405]:     </video>
Aug 08 23:22:51 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:22:51 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:22:51 user nova-compute[72405]:     </rng>
Aug 08 23:22:51 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:22:51 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:22:51 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:22:51 user nova-compute[72405]:     </memballoon>
Aug 08 23:22:51 user nova-compute[72405]:   </devices>
Aug 08 23:22:51 user nova-compute[72405]: </domain>
Aug 08 23:22:51 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG os_vif [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8654907e-98, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8654907e-98, col_values=(('external_ids', {'iface-id': '8654907e-9844-4cf4-8754-5b540b3aa53c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:53:af', 'vm-uuid': '80e7599c-bd2a-499d-9b2b-4c613f375900'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:51 user nova-compute[72405]: INFO os_vif [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98')
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No VIF found with MAC fa:16:3e:f6:53:af, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:22:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Successfully updated port: 95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquired lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-changed-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Refreshing instance network info cache due to event network-changed-95cda028-ebac-494b-a9cc-0e4b0511d395. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] Acquiring lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.neutron [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updating instance_info_cache with network_info: [{"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Releasing lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Instance network_info: |[{"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] Acquired lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.neutron [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Refreshing network info cache for port 95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Start _get_guest_xml network_info=[{"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:22:53 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:53 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-395984649',display_name='tempest-AttachVolumeNegativeTest-server-395984649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-395984649',id=4,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVskqEeg50RKMxJkJVi4ko7k4s8eUARaDtCTgw/m3lw4nhP4jV/u1xIqv7cOLIXjn+ff7Xjh3wNZHdsROkFDVqr+iKtgiIrQL7MOpErjmWUL1wYO9reDFjXhROY9OlZ6g==',key_name='tempest-keypair-1263103113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-tq30zn0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=2b6e716f-3376-4f79-8ad5-95bd1d5231f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:22:53 user nova-compute[72405]:   <uuid>2b6e716f-3376-4f79-8ad5-95bd1d5231f7</uuid>
Aug 08 23:22:53 user nova-compute[72405]:   <name>instance-00000004</name>
Aug 08 23:22:53 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:22:53 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:22:53 user nova-compute[72405]:   <metadata>
Aug 08 23:22:53 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:22:53 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:22:53 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeNegativeTest-server-395984649</nova:name>
Aug 08 23:22:53 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:22:53</nova:creationTime>
Aug 08 23:22:53 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:22:53 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:22:53 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:22:53 user nova-compute[72405]:       <nova:owner>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:user uuid="5eb8334edbf14ec382f6cd1c426703c6">tempest-AttachVolumeNegativeTest-1663634564-project-member</nova:user>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:project uuid="4a146c9a0c224249ac3316e931874bc5">tempest-AttachVolumeNegativeTest-1663634564</nova:project>
Aug 08 23:22:53 user nova-compute[72405]:       </nova:owner>
Aug 08 23:22:53 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:22:53 user nova-compute[72405]:       <nova:ports>
Aug 08 23:22:53 user nova-compute[72405]:         <nova:port uuid="95cda028-ebac-494b-a9cc-0e4b0511d395">
Aug 08 23:22:53 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 08 23:22:53 user nova-compute[72405]:         </nova:port>
Aug 08 23:22:53 user nova-compute[72405]:       </nova:ports>
Aug 08 23:22:53 user nova-compute[72405]:     </nova:instance>
Aug 08 23:22:53 user nova-compute[72405]:   </metadata>
Aug 08 23:22:53 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:22:53 user nova-compute[72405]:     <system>
Aug 08 23:22:53 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:22:53 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:22:53 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:22:53 user nova-compute[72405]:       <entry name="serial">2b6e716f-3376-4f79-8ad5-95bd1d5231f7</entry>
Aug 08 23:22:53 user nova-compute[72405]:       <entry name="uuid">2b6e716f-3376-4f79-8ad5-95bd1d5231f7</entry>
Aug 08 23:22:53 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:22:53 user nova-compute[72405]:     </system>
Aug 08 23:22:53 user nova-compute[72405]:   </sysinfo>
Aug 08 23:22:53 user nova-compute[72405]:   <os>
Aug 08 23:22:53 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:22:53 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:22:53 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:22:53 user nova-compute[72405]:   </os>
Aug 08 23:22:53 user nova-compute[72405]:   <features>
Aug 08 23:22:53 user nova-compute[72405]:     <acpi/>
Aug 08 23:22:53 user nova-compute[72405]:     <apic/>
Aug 08 23:22:53 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:22:53 user nova-compute[72405]:   </features>
Aug 08 23:22:53 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:22:53 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:22:53 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:22:53 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:22:53 user nova-compute[72405]:   </clock>
Aug 08 23:22:53 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:22:53 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:22:53 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:22:53 user nova-compute[72405]:   </cpu>
Aug 08 23:22:53 user nova-compute[72405]:   <devices>
Aug 08 23:22:53 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:22:53 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:22:53 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk"/>
Aug 08 23:22:53 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:22:53 user nova-compute[72405]:     </disk>
Aug 08 23:22:53 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:22:53 user nova-compute[72405]:       <mac address="fa:16:3e:3e:2c:15"/>
Aug 08 23:22:53 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:53 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:22:53 user nova-compute[72405]:       <target dev="tap95cda028-eb"/>
Aug 08 23:22:53 user nova-compute[72405]:     </interface>
Aug 08 23:22:53 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:22:53 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/console.log" append="off"/>
Aug 08 23:22:53 user nova-compute[72405]:     </serial>
Aug 08 23:22:53 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:22:53 user nova-compute[72405]:     <video>
Aug 08 23:22:53 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:53 user nova-compute[72405]:     </video>
Aug 08 23:22:53 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:22:53 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:22:53 user nova-compute[72405]:     </rng>
Aug 08 23:22:53 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:22:53 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:22:53 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:22:53 user nova-compute[72405]:     </memballoon>
Aug 08 23:22:53 user nova-compute[72405]:   </devices>
Aug 08 23:22:53 user nova-compute[72405]: </domain>
Aug 08 23:22:53 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-395984649',display_name='tempest-AttachVolumeNegativeTest-server-395984649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-395984649',id=4,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVskqEeg50RKMxJkJVi4ko7k4s8eUARaDtCTgw/m3lw4nhP4jV/u1xIqv7cOLIXjn+ff7Xjh3wNZHdsROkFDVqr+iKtgiIrQL7MOpErjmWUL1wYO9reDFjXhROY9OlZ6g==',key_name='tempest-keypair-1263103113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-tq30zn0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=2b6e716f-3376-4f79-8ad5-95bd1d5231f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG os_vif [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95cda028-eb, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95cda028-eb, col_values=(('external_ids', {'iface-id': '95cda028-ebac-494b-a9cc-0e4b0511d395', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:2c:15', 'vm-uuid': '2b6e716f-3376-4f79-8ad5-95bd1d5231f7'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: INFO os_vif [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb')
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:3e:2c:15, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.neutron [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updated VIF entry in instance network info cache for port 8654907e-9844-4cf4-8754-5b540b3aa53c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG nova.network.neutron [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3b246d48-bf5f-4008-bb69-28ca51c453d7 req-7df7696d-3a6a-48e6-948f-7e6903b9e8ff service nova] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-fc61a050-bd77-4316-a3d1-45252d7dd50b req-38e3b4c6-2e34-46e7-bca5-ae7302999606 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fc61a050-bd77-4316-a3d1-45252d7dd50b req-38e3b4c6-2e34-46e7-bca5-ae7302999606 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fc61a050-bd77-4316-a3d1-45252d7dd50b req-38e3b4c6-2e34-46e7-bca5-ae7302999606 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fc61a050-bd77-4316-a3d1-45252d7dd50b req-38e3b4c6-2e34-46e7-bca5-ae7302999606 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-fc61a050-bd77-4316-a3d1-45252d7dd50b req-38e3b4c6-2e34-46e7-bca5-ae7302999606 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:54 user nova-compute[72405]: WARNING nova.compute.manager [req-fc61a050-bd77-4316-a3d1-45252d7dd50b req-38e3b4c6-2e34-46e7-bca5-ae7302999606 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state building and task_state spawning.
Aug 08 23:22:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updated VIF entry in instance network info cache for port 95cda028-ebac-494b-a9cc-0e4b0511d395. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updating instance_info_cache with network_info: [{"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-99be9955-dfb1-44e6-85b5-6084d44f9dab req-9a652680-0674-4e5e-ac67-7f13ef55d7d0 service nova] Releasing lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Successfully updated port: 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing instance network info cache due to event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:22:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance network_info: |[{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.neutron [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Start _get_guest_xml network_info=[{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:22:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1634977089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1634977089',id=5,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBT4Lyh9dl7ZNEvz9gDo3XYV4USF1K1eFewyehMSS7XV3yHhOoLkyg3N7NLRn9b+Wg3ImzdxmsasFpRmWm/DC/IQZPdxfY42D81mzjUYsH6M+17eIcBNI+h4OYTjCNGmQ==',key_name='tempest-keypair-380907040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-ozqx2sck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=16d8b7a1-0c6b-444f-b17c-c64caa2ece8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'pci_devices' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:22:55 user nova-compute[72405]:   <uuid>16d8b7a1-0c6b-444f-b17c-c64caa2ece8c</uuid>
Aug 08 23:22:55 user nova-compute[72405]:   <name>instance-00000005</name>
Aug 08 23:22:55 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:22:55 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:22:55 user nova-compute[72405]:   <metadata>
Aug 08 23:22:55 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:22:55 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:22:55 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1634977089</nova:name>
Aug 08 23:22:55 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:22:55</nova:creationTime>
Aug 08 23:22:55 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:22:55 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:22:55 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:22:55 user nova-compute[72405]:       <nova:owner>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:user uuid="fb25719ffe4c467e8afc3f6b8fe4d712">tempest-AttachVolumeShelveTestJSON-1695202964-project-member</nova:user>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:project uuid="94f6dc799f1b4698b15a3ea91c8dbea9">tempest-AttachVolumeShelveTestJSON-1695202964</nova:project>
Aug 08 23:22:55 user nova-compute[72405]:       </nova:owner>
Aug 08 23:22:55 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:22:55 user nova-compute[72405]:       <nova:ports>
Aug 08 23:22:55 user nova-compute[72405]:         <nova:port uuid="9a42571c-14a5-4457-b5f9-4a1de6ed2d4d">
Aug 08 23:22:55 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 08 23:22:55 user nova-compute[72405]:         </nova:port>
Aug 08 23:22:55 user nova-compute[72405]:       </nova:ports>
Aug 08 23:22:55 user nova-compute[72405]:     </nova:instance>
Aug 08 23:22:55 user nova-compute[72405]:   </metadata>
Aug 08 23:22:55 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:22:55 user nova-compute[72405]:     <system>
Aug 08 23:22:55 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:22:55 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:22:55 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:22:55 user nova-compute[72405]:       <entry name="serial">16d8b7a1-0c6b-444f-b17c-c64caa2ece8c</entry>
Aug 08 23:22:55 user nova-compute[72405]:       <entry name="uuid">16d8b7a1-0c6b-444f-b17c-c64caa2ece8c</entry>
Aug 08 23:22:55 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:22:55 user nova-compute[72405]:     </system>
Aug 08 23:22:55 user nova-compute[72405]:   </sysinfo>
Aug 08 23:22:55 user nova-compute[72405]:   <os>
Aug 08 23:22:55 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:22:55 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:22:55 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:22:55 user nova-compute[72405]:   </os>
Aug 08 23:22:55 user nova-compute[72405]:   <features>
Aug 08 23:22:55 user nova-compute[72405]:     <acpi/>
Aug 08 23:22:55 user nova-compute[72405]:     <apic/>
Aug 08 23:22:55 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:22:55 user nova-compute[72405]:   </features>
Aug 08 23:22:55 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:22:55 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:22:55 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:22:55 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:22:55 user nova-compute[72405]:   </clock>
Aug 08 23:22:55 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:22:55 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:22:55 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:22:55 user nova-compute[72405]:   </cpu>
Aug 08 23:22:55 user nova-compute[72405]:   <devices>
Aug 08 23:22:55 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:22:55 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:22:55 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk"/>
Aug 08 23:22:55 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:22:55 user nova-compute[72405]:     </disk>
Aug 08 23:22:55 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:22:55 user nova-compute[72405]:       <mac address="fa:16:3e:61:fd:10"/>
Aug 08 23:22:55 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:55 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:22:55 user nova-compute[72405]:       <target dev="tap9a42571c-14"/>
Aug 08 23:22:55 user nova-compute[72405]:     </interface>
Aug 08 23:22:55 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:22:55 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/console.log" append="off"/>
Aug 08 23:22:55 user nova-compute[72405]:     </serial>
Aug 08 23:22:55 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:22:55 user nova-compute[72405]:     <video>
Aug 08 23:22:55 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:22:55 user nova-compute[72405]:     </video>
Aug 08 23:22:55 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:22:55 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:22:55 user nova-compute[72405]:     </rng>
Aug 08 23:22:55 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:22:55 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:22:55 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:22:55 user nova-compute[72405]:     </memballoon>
Aug 08 23:22:55 user nova-compute[72405]:   </devices>
Aug 08 23:22:55 user nova-compute[72405]: </domain>
Aug 08 23:22:55 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1634977089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1634977089',id=5,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBT4Lyh9dl7ZNEvz9gDo3XYV4USF1K1eFewyehMSS7XV3yHhOoLkyg3N7NLRn9b+Wg3ImzdxmsasFpRmWm/DC/IQZPdxfY42D81mzjUYsH6M+17eIcBNI+h4OYTjCNGmQ==',key_name='tempest-keypair-380907040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-ozqx2sck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=16d8b7a1-0c6b-444f-b17c-c64caa2ece8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG os_vif [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a42571c-14, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a42571c-14, col_values=(('external_ids', {'iface-id': '9a42571c-14a5-4457-b5f9-4a1de6ed2d4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:fd:10', 'vm-uuid': '16d8b7a1-0c6b-444f-b17c-c64caa2ece8c'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:55 user nova-compute[72405]: INFO os_vif [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14')
Aug 08 23:22:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No VIF found with MAC fa:16:3e:61:fd:10, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:56 user nova-compute[72405]: WARNING nova.compute.manager [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state building and task_state spawning.
Aug 08 23:22:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] No waiting events found dispatching network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:56 user nova-compute[72405]: WARNING nova.compute.manager [req-9776e95a-c33a-434a-9381-cded19ec8048 req-20f6c3e3-2eb4-4793-b2c2-be8103062071 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received unexpected event network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 for instance with vm_state building and task_state spawning.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536977.1612172, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Resumed (Lifecycle Event)
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance spawned successfully.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updated VIF entry in instance network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2480f25b-bf60-4bd9-a9d7-489b7372e8dc req-807c83df-f371-4569-8f37-c3f3661135a0 service nova] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536977.1659865, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Started (Lifecycle Event)
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Took 16.95 seconds to spawn the instance on the hypervisor.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Took 17.89 seconds to build instance.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaade70b-da00-4e37-861d-5f69ad1cad16 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.104s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536977.7438226, 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] VM Resumed (Lifecycle Event)
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Instance spawned successfully.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536977.7496617, 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] VM Started (Lifecycle Event)
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:22:57 user nova-compute[72405]: INFO nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Took 11.43 seconds to spawn the instance on the hypervisor.
Aug 08 23:22:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:22:58 user nova-compute[72405]: INFO nova.compute.manager [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Took 12.30 seconds to build instance.
Aug 08 23:22:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a7e5ba71-05da-44d0-bc48-9e58786c2db4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.447s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd12715d-eba8-47db-bbf1-1753a7af0adc req-7567c817-efd7-4651-bb63-8d538ea1c9c3 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd12715d-eba8-47db-bbf1-1753a7af0adc req-7567c817-efd7-4651-bb63-8d538ea1c9c3 service nova] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd12715d-eba8-47db-bbf1-1753a7af0adc req-7567c817-efd7-4651-bb63-8d538ea1c9c3 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd12715d-eba8-47db-bbf1-1753a7af0adc req-7567c817-efd7-4651-bb63-8d538ea1c9c3 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd12715d-eba8-47db-bbf1-1753a7af0adc req-7567c817-efd7-4651-bb63-8d538ea1c9c3 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] No waiting events found dispatching network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:58 user nova-compute[72405]: WARNING nova.compute.manager [req-bd12715d-eba8-47db-bbf1-1753a7af0adc req-7567c817-efd7-4651-bb63-8d538ea1c9c3 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received unexpected event network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 for instance with vm_state active and task_state None.
Aug 08 23:22:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-e8496173-53b4-460b-8c9f-30ce9e5d8c7b req-70b95b1a-4f5e-4fb8-826e-a9d7455d77b4 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:22:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e8496173-53b4-460b-8c9f-30ce9e5d8c7b req-70b95b1a-4f5e-4fb8-826e-a9d7455d77b4 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:22:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e8496173-53b4-460b-8c9f-30ce9e5d8c7b req-70b95b1a-4f5e-4fb8-826e-a9d7455d77b4 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:22:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e8496173-53b4-460b-8c9f-30ce9e5d8c7b req-70b95b1a-4f5e-4fb8-826e-a9d7455d77b4 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:22:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-e8496173-53b4-460b-8c9f-30ce9e5d8c7b req-70b95b1a-4f5e-4fb8-826e-a9d7455d77b4 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:22:59 user nova-compute[72405]: WARNING nova.compute.manager [req-e8496173-53b4-460b-8c9f-30ce9e5d8c7b req-70b95b1a-4f5e-4fb8-826e-a9d7455d77b4 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state building and task_state spawning.
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536980.2688985, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] VM Resumed (Lifecycle Event)
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance spawned successfully.
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536980.2689912, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] VM Started (Lifecycle Event)
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Took 13.51 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:00 user nova-compute[72405]: INFO nova.compute.manager [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Took 14.78 seconds to build instance.
Aug 08 23:23:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7a54e11c-e2f9-470d-8336-d193f949f1e3 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.894s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "139270d7-7024-4397-a005-618e17165718" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-02485e1c-73d5-4159-b66d-0296fbc9cd65 req-e3f0a13e-02c4-4fff-a61b-a92d423acaa9 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02485e1c-73d5-4159-b66d-0296fbc9cd65 req-e3f0a13e-02c4-4fff-a61b-a92d423acaa9 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02485e1c-73d5-4159-b66d-0296fbc9cd65 req-e3f0a13e-02c4-4fff-a61b-a92d423acaa9 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02485e1c-73d5-4159-b66d-0296fbc9cd65 req-e3f0a13e-02c4-4fff-a61b-a92d423acaa9 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-02485e1c-73d5-4159-b66d-0296fbc9cd65 req-e3f0a13e-02c4-4fff-a61b-a92d423acaa9 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:01 user nova-compute[72405]: WARNING nova.compute.manager [req-02485e1c-73d5-4159-b66d-0296fbc9cd65 req-e3f0a13e-02c4-4fff-a61b-a92d423acaa9 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state active and task_state None.
Aug 08 23:23:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:23:01 user nova-compute[72405]: INFO nova.compute.claims [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Claim successful on node user
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.799s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:23:02 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.policy [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9478bdd596664d2fbbc76949a2184097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af46e92617d4d34b57ac1267eb1ed35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:23:02 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Creating image(s)
Aug 08 23:23:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "/opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "/opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "/opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "18cd5b9fe964dfcd18950ef1dde087ba625ed0fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "18cd5b9fe964dfcd18950ef1dde087ba625ed0fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.part --force-share --output=json" returned: 0 in 0.217s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG nova.virt.images [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] fb5062c4-5e74-4d87-9f17-faf18efde395 was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:23:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.part /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:23:04 user nova-compute[72405]: INFO nova.compute.claims [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Claim successful on node user
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.part /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.converted" returned: 0 in 0.417s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Successfully created port: 886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "18cd5b9fe964dfcd18950ef1dde087ba625ed0fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd --force-share --output=json" returned: 0 in 0.224s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "18cd5b9fe964dfcd18950ef1dde087ba625ed0fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "18cd5b9fe964dfcd18950ef1dde087ba625ed0fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd --force-share --output=json" returned: 0 in 0.211s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd,backing_fmt=raw /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd,backing_fmt=raw /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk 1073741824" returned: 0 in 0.072s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "18cd5b9fe964dfcd18950ef1dde087ba625ed0fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd --force-share --output=json" returned: 0 in 0.174s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.132s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Cannot resize image /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lazy-loading 'migration_context' on Instance uuid 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Ensure instance console log exists: /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:23:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.policy [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d9d95793fbe40989729a80e72bde91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ac2c8f4474e83abe622858fe2fd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:23:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Creating image(s)
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "/opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "/opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Successfully updated port: 886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.181s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquired lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-changed-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Refreshing instance network info cache due to event network-changed-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] Acquiring lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.186s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk 1073741824" returned: 0 in 0.075s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.223s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Updating instance_info_cache with network_info: [{"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Cannot resize image /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:23:06 user nova-compute[72405]: DEBUG nova.objects.instance [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'migration_context' on Instance uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Ensure instance console log exists: /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Releasing lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Instance network_info: |[{"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] Acquired lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Refreshing network info cache for port 886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Start _get_guest_xml network_info=[{"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:22:51Z,direct_url=<?>,disk_format='qcow2',id=fb5062c4-5e74-4d87-9f17-faf18efde395,min_disk=0,min_ram=0,name='',owner='6d9cd23258774d01a1ea93da78174c32',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:22:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/sda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'fb5062c4-5e74-4d87-9f17-faf18efde395'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Successfully created port: d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:23:07 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:07 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:22:51Z,direct_url=<?>,disk_format='qcow2',id=fb5062c4-5e74-4d87-9f17-faf18efde395,min_disk=0,min_ram=0,name='',owner='6d9cd23258774d01a1ea93da78174c32',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:22:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1985319289',display_name='tempest-AttachSCSIVolumeTestJSON-server-1985319289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1985319289',id=6,image_ref='fb5062c4-5e74-4d87-9f17-faf18efde395',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPf/H+Jr3bks+3QJdPEnaIn6mgjQZ+3+XP7R6CbgfwB+ipqI/ArOAIDRcsB715AXn60yOv7E+lUmn+u+KfTMOGRrdnHQ0+m9YuKP8o2XnEFbkqY+oiN4jyZ+uw68X5cog==',key_name='tempest-keypair-1976994048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2af46e92617d4d34b57ac1267eb1ed35',ramdisk_id='',reservation_id='r-3bwgtp0j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb5062c4-5e74-4d87-9f17-faf18efde395',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-773745210',owner_user_name='tempest-AttachSCSIVolumeTestJSON-773745210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9478bdd596664d2fbbc76949a2184097',uuid=139270d7-7024-4397-a005-618e17165718,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Converting VIF {"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lazy-loading 'pci_devices' on Instance uuid 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:23:07 user nova-compute[72405]:   <uuid>139270d7-7024-4397-a005-618e17165718</uuid>
Aug 08 23:23:07 user nova-compute[72405]:   <name>instance-00000006</name>
Aug 08 23:23:07 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:23:07 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:23:07 user nova-compute[72405]:   <metadata>
Aug 08 23:23:07 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:23:07 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:23:07 user nova-compute[72405]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1985319289</nova:name>
Aug 08 23:23:07 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:23:07</nova:creationTime>
Aug 08 23:23:07 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:23:07 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:23:07 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:23:07 user nova-compute[72405]:       <nova:owner>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:user uuid="9478bdd596664d2fbbc76949a2184097">tempest-AttachSCSIVolumeTestJSON-773745210-project-member</nova:user>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:project uuid="2af46e92617d4d34b57ac1267eb1ed35">tempest-AttachSCSIVolumeTestJSON-773745210</nova:project>
Aug 08 23:23:07 user nova-compute[72405]:       </nova:owner>
Aug 08 23:23:07 user nova-compute[72405]:       <nova:root type="image" uuid="fb5062c4-5e74-4d87-9f17-faf18efde395"/>
Aug 08 23:23:07 user nova-compute[72405]:       <nova:ports>
Aug 08 23:23:07 user nova-compute[72405]:         <nova:port uuid="886e7e28-cba5-4fdd-956e-b2b1a1ca7d06">
Aug 08 23:23:07 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 08 23:23:07 user nova-compute[72405]:         </nova:port>
Aug 08 23:23:07 user nova-compute[72405]:       </nova:ports>
Aug 08 23:23:07 user nova-compute[72405]:     </nova:instance>
Aug 08 23:23:07 user nova-compute[72405]:   </metadata>
Aug 08 23:23:07 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:23:07 user nova-compute[72405]:     <system>
Aug 08 23:23:07 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:23:07 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:23:07 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:23:07 user nova-compute[72405]:       <entry name="serial">139270d7-7024-4397-a005-618e17165718</entry>
Aug 08 23:23:07 user nova-compute[72405]:       <entry name="uuid">139270d7-7024-4397-a005-618e17165718</entry>
Aug 08 23:23:07 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:23:07 user nova-compute[72405]:     </system>
Aug 08 23:23:07 user nova-compute[72405]:   </sysinfo>
Aug 08 23:23:07 user nova-compute[72405]:   <os>
Aug 08 23:23:07 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:23:07 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:23:07 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:23:07 user nova-compute[72405]:   </os>
Aug 08 23:23:07 user nova-compute[72405]:   <features>
Aug 08 23:23:07 user nova-compute[72405]:     <acpi/>
Aug 08 23:23:07 user nova-compute[72405]:     <apic/>
Aug 08 23:23:07 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:23:07 user nova-compute[72405]:   </features>
Aug 08 23:23:07 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:23:07 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:23:07 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:23:07 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:23:07 user nova-compute[72405]:   </clock>
Aug 08 23:23:07 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:23:07 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:23:07 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:23:07 user nova-compute[72405]:   </cpu>
Aug 08 23:23:07 user nova-compute[72405]:   <devices>
Aug 08 23:23:07 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:23:07 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:23:07 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk"/>
Aug 08 23:23:07 user nova-compute[72405]:       <target dev="sda" bus="scsi"/>
Aug 08 23:23:07 user nova-compute[72405]:       <address type="drive" controller="0" unit="0"/>
Aug 08 23:23:07 user nova-compute[72405]:     </disk>
Aug 08 23:23:07 user nova-compute[72405]:     <disk type="file" device="cdrom">
Aug 08 23:23:07 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none"/>
Aug 08 23:23:07 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.config"/>
Aug 08 23:23:07 user nova-compute[72405]:       <target dev="sdb" bus="scsi"/>
Aug 08 23:23:07 user nova-compute[72405]:       <address type="drive" controller="0" unit="1"/>
Aug 08 23:23:07 user nova-compute[72405]:     </disk>
Aug 08 23:23:07 user nova-compute[72405]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 08 23:23:07 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:23:07 user nova-compute[72405]:       <mac address="fa:16:3e:2f:1b:85"/>
Aug 08 23:23:07 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:07 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:23:07 user nova-compute[72405]:       <target dev="tap886e7e28-cb"/>
Aug 08 23:23:07 user nova-compute[72405]:     </interface>
Aug 08 23:23:07 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:23:07 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/console.log" append="off"/>
Aug 08 23:23:07 user nova-compute[72405]:     </serial>
Aug 08 23:23:07 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:23:07 user nova-compute[72405]:     <video>
Aug 08 23:23:07 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:07 user nova-compute[72405]:     </video>
Aug 08 23:23:07 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:23:07 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:23:07 user nova-compute[72405]:     </rng>
Aug 08 23:23:07 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:23:07 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:23:07 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:23:07 user nova-compute[72405]:     </memballoon>
Aug 08 23:23:07 user nova-compute[72405]:   </devices>
Aug 08 23:23:07 user nova-compute[72405]: </domain>
Aug 08 23:23:07 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1985319289',display_name='tempest-AttachSCSIVolumeTestJSON-server-1985319289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1985319289',id=6,image_ref='fb5062c4-5e74-4d87-9f17-faf18efde395',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPf/H+Jr3bks+3QJdPEnaIn6mgjQZ+3+XP7R6CbgfwB+ipqI/ArOAIDRcsB715AXn60yOv7E+lUmn+u+KfTMOGRrdnHQ0+m9YuKP8o2XnEFbkqY+oiN4jyZ+uw68X5cog==',key_name='tempest-keypair-1976994048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2af46e92617d4d34b57ac1267eb1ed35',ramdisk_id='',reservation_id='r-3bwgtp0j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb5062c4-5e74-4d87-9f17-faf18efde395',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-773745210',owner_user_name='tempest-AttachSCSIVolumeTestJSON-773745210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9478bdd596664d2fbbc76949a2184097',uuid=139270d7-7024-4397-a005-618e17165718,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Converting VIF {"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG os_vif [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap886e7e28-cb, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap886e7e28-cb, col_values=(('external_ids', {'iface-id': '886e7e28-cba5-4fdd-956e-b2b1a1ca7d06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:1b:85', 'vm-uuid': '139270d7-7024-4397-a005-618e17165718'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:07 user nova-compute[72405]: INFO os_vif [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb')
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No BDM found with device name sda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No VIF found with MAC fa:16:3e:2f:1b:85, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:23:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Using config drive
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Updated VIF entry in instance network info cache for port 886e7e28-cba5-4fdd-956e-b2b1a1ca7d06. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Updating instance_info_cache with network_info: [{"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80666752-930c-4899-b00c-d0e4686ba9d0 req-01e10b50-c61d-429f-9a4a-5ded3eaa9fde service nova] Releasing lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Creating config drive at /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.config
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxcab0itr {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxcab0itr" returned: 0 in 0.085s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Successfully updated port: d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquired lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-changed-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Refreshing instance network info cache due to event network-changed-d3dc4ecd-2751-40aa-9424-b64b17934399. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] Acquiring lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updating instance_info_cache with network_info: [{"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Releasing lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Instance network_info: |[{"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] Acquired lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Refreshing network info cache for port d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Start _get_guest_xml network_info=[{"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:23:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-755080970',display_name='tempest-VolumesAdminNegativeTest-server-755080970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-755080970',id=7,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDga8EauNxj6yRwgLz83JXtJJtpPexB+kxhktsKSs7HyRqeeqkv8IbftH8byKyBQzLdF7vW0QNVfQmgsOsQVdhGs/PhZLu0dsFs3bRW1OGULHayQbH1rHN7bE921q5RjXA==',key_name='tempest-keypair-1061114838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c2ac2c8f4474e83abe622858fe2fd1d',ramdisk_id='',reservation_id='r-0eu15v1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1763761892',owner_user_name='tempest-VolumesAdminNegativeTest-1763761892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d9d95793fbe40989729a80e72bde91d',uuid=8fba4b8e-8a40-473a-9fc2-2d06ec128463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converting VIF {"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:23:08 user nova-compute[72405]:   <uuid>8fba4b8e-8a40-473a-9fc2-2d06ec128463</uuid>
Aug 08 23:23:08 user nova-compute[72405]:   <name>instance-00000007</name>
Aug 08 23:23:08 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:23:08 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:23:08 user nova-compute[72405]:   <metadata>
Aug 08 23:23:08 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:23:08 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:23:08 user nova-compute[72405]:       <nova:name>tempest-VolumesAdminNegativeTest-server-755080970</nova:name>
Aug 08 23:23:08 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:23:08</nova:creationTime>
Aug 08 23:23:08 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:23:08 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:23:08 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:23:08 user nova-compute[72405]:       <nova:owner>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:user uuid="5d9d95793fbe40989729a80e72bde91d">tempest-VolumesAdminNegativeTest-1763761892-project-member</nova:user>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:project uuid="0c2ac2c8f4474e83abe622858fe2fd1d">tempest-VolumesAdminNegativeTest-1763761892</nova:project>
Aug 08 23:23:08 user nova-compute[72405]:       </nova:owner>
Aug 08 23:23:08 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:23:08 user nova-compute[72405]:       <nova:ports>
Aug 08 23:23:08 user nova-compute[72405]:         <nova:port uuid="d3dc4ecd-2751-40aa-9424-b64b17934399">
Aug 08 23:23:08 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 08 23:23:08 user nova-compute[72405]:         </nova:port>
Aug 08 23:23:08 user nova-compute[72405]:       </nova:ports>
Aug 08 23:23:08 user nova-compute[72405]:     </nova:instance>
Aug 08 23:23:08 user nova-compute[72405]:   </metadata>
Aug 08 23:23:08 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:23:08 user nova-compute[72405]:     <system>
Aug 08 23:23:08 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:23:08 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:23:08 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:23:08 user nova-compute[72405]:       <entry name="serial">8fba4b8e-8a40-473a-9fc2-2d06ec128463</entry>
Aug 08 23:23:08 user nova-compute[72405]:       <entry name="uuid">8fba4b8e-8a40-473a-9fc2-2d06ec128463</entry>
Aug 08 23:23:08 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:23:08 user nova-compute[72405]:     </system>
Aug 08 23:23:08 user nova-compute[72405]:   </sysinfo>
Aug 08 23:23:08 user nova-compute[72405]:   <os>
Aug 08 23:23:08 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:23:08 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:23:08 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:23:08 user nova-compute[72405]:   </os>
Aug 08 23:23:08 user nova-compute[72405]:   <features>
Aug 08 23:23:08 user nova-compute[72405]:     <acpi/>
Aug 08 23:23:08 user nova-compute[72405]:     <apic/>
Aug 08 23:23:08 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:23:08 user nova-compute[72405]:   </features>
Aug 08 23:23:08 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:23:08 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:23:08 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:23:08 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:23:08 user nova-compute[72405]:   </clock>
Aug 08 23:23:08 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:23:08 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:23:08 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:23:08 user nova-compute[72405]:   </cpu>
Aug 08 23:23:08 user nova-compute[72405]:   <devices>
Aug 08 23:23:08 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:23:08 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:23:08 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk"/>
Aug 08 23:23:08 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:23:08 user nova-compute[72405]:     </disk>
Aug 08 23:23:08 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:23:08 user nova-compute[72405]:       <mac address="fa:16:3e:e6:0f:98"/>
Aug 08 23:23:08 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:08 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:23:08 user nova-compute[72405]:       <target dev="tapd3dc4ecd-27"/>
Aug 08 23:23:08 user nova-compute[72405]:     </interface>
Aug 08 23:23:08 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:23:08 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/console.log" append="off"/>
Aug 08 23:23:08 user nova-compute[72405]:     </serial>
Aug 08 23:23:08 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:23:08 user nova-compute[72405]:     <video>
Aug 08 23:23:08 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:08 user nova-compute[72405]:     </video>
Aug 08 23:23:08 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:23:08 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:23:08 user nova-compute[72405]:     </rng>
Aug 08 23:23:08 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:23:08 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:23:08 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:23:08 user nova-compute[72405]:     </memballoon>
Aug 08 23:23:08 user nova-compute[72405]:   </devices>
Aug 08 23:23:08 user nova-compute[72405]: </domain>
Aug 08 23:23:08 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-755080970',display_name='tempest-VolumesAdminNegativeTest-server-755080970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-755080970',id=7,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDga8EauNxj6yRwgLz83JXtJJtpPexB+kxhktsKSs7HyRqeeqkv8IbftH8byKyBQzLdF7vW0QNVfQmgsOsQVdhGs/PhZLu0dsFs3bRW1OGULHayQbH1rHN7bE921q5RjXA==',key_name='tempest-keypair-1061114838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c2ac2c8f4474e83abe622858fe2fd1d',ramdisk_id='',reservation_id='r-0eu15v1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1763761892',owner_user_name='tempest-VolumesAdminNegativeTest-1763761892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d9d95793fbe40989729a80e72bde91d',uuid=8fba4b8e-8a40-473a-9fc2-2d06ec128463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converting VIF {"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG os_vif [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3dc4ecd-27, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3dc4ecd-27, col_values=(('external_ids', {'iface-id': 'd3dc4ecd-2751-40aa-9424-b64b17934399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:0f:98', 'vm-uuid': '8fba4b8e-8a40-473a-9fc2-2d06ec128463'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:08 user nova-compute[72405]: INFO os_vif [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27')
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No VIF found with MAC fa:16:3e:e6:0f:98, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:23:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updated VIF entry in instance network info cache for port d3dc4ecd-2751-40aa-9424-b64b17934399. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:23:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updating instance_info_cache with network_info: [{"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-213284f9-3ce2-47d7-a585-b70fd8423ba5 req-cb54e8ae-dda6-4e83-86c8-d5f7e797cfc3 service nova] Releasing lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-e5889663-fec3-4b72-83f9-db97e72f462c req-d02c5f74-15ba-47fe-8633-43facbfd918b service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e5889663-fec3-4b72-83f9-db97e72f462c req-d02c5f74-15ba-47fe-8633-43facbfd918b service nova] Acquiring lock "139270d7-7024-4397-a005-618e17165718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e5889663-fec3-4b72-83f9-db97e72f462c req-d02c5f74-15ba-47fe-8633-43facbfd918b service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e5889663-fec3-4b72-83f9-db97e72f462c req-d02c5f74-15ba-47fe-8633-43facbfd918b service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-e5889663-fec3-4b72-83f9-db97e72f462c req-d02c5f74-15ba-47fe-8633-43facbfd918b service nova] [instance: 139270d7-7024-4397-a005-618e17165718] No waiting events found dispatching network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:10 user nova-compute[72405]: WARNING nova.compute.manager [req-e5889663-fec3-4b72-83f9-db97e72f462c req-d02c5f74-15ba-47fe-8633-43facbfd918b service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received unexpected event network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 for instance with vm_state building and task_state spawning.
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Acquiring lock "139270d7-7024-4397-a005-618e17165718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] No waiting events found dispatching network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:12 user nova-compute[72405]: WARNING nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received unexpected event network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 for instance with vm_state building and task_state spawning.
Aug 08 23:23:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] No waiting events found dispatching network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:12 user nova-compute[72405]: WARNING nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received unexpected event network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 for instance with vm_state building and task_state spawning.
Aug 08 23:23:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] No waiting events found dispatching network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:12 user nova-compute[72405]: WARNING nova.compute.manager [req-4e410a0c-1707-4d25-b129-4d551656eb10 req-a3125547-0e2c-49e6-91a5-606424e7caa1 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received unexpected event network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 for instance with vm_state building and task_state spawning.
Aug 08 23:23:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536994.257028, 139270d7-7024-4397-a005-618e17165718 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] VM Resumed (Lifecycle Event)
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 139270d7-7024-4397-a005-618e17165718] Instance spawned successfully.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Instance spawned successfully.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536994.2661622, 139270d7-7024-4397-a005-618e17165718 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] VM Started (Lifecycle Event)
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Took 11.49 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Took 8.71 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 139270d7-7024-4397-a005-618e17165718] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536994.284022, 8fba4b8e-8a40-473a-9fc2-2d06ec128463 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] VM Resumed (Lifecycle Event)
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691536994.2841003, 8fba4b8e-8a40-473a-9fc2-2d06ec128463 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] VM Started (Lifecycle Event)
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Took 10.59 seconds to build instance.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:14 user nova-compute[72405]: INFO nova.compute.manager [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Took 13.03 seconds to build instance.
Aug 08 23:23:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-67a9eaab-4c2e-4675-b018-c6f844c45ee2 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.812s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcecb080-1adc-458b-8c7a-b9ce47d9bfe1 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.281s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:23:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:23:16 user nova-compute[72405]: INFO nova.compute.claims [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Claim successful on node user
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:23:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.policy [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1da7c19e65443d49ebd11d20955166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4229ea3198b846819520ed06edf0eecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:23:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Creating image(s)
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk 1073741824" returned: 0 in 0.057s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.176s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Cannot resize image /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'migration_context' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Ensure instance console log exists: /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG nova.network.neutron [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Successfully created port: 67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:23:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:23:19 user nova-compute[72405]: DEBUG nova.network.neutron [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Successfully updated port: 67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquired lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.neutron [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-changed-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Refreshing instance network info cache due to event network-changed-67827618-228c-474c-adaf-4692e1251fc1. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] Acquiring lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:23:20 user nova-compute[72405]: INFO nova.compute.claims [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Claim successful on node user
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.neutron [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.neutron [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Releasing lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Instance network_info: |[{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] Acquired lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.neutron [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Refreshing network info cache for port 67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Start _get_guest_xml network_info=[{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:23:20 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:20 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'pci_devices' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:23:20 user nova-compute[72405]:   <uuid>29c4e0e6-85dc-4db6-a801-2ff6a19115db</uuid>
Aug 08 23:23:20 user nova-compute[72405]:   <name>instance-00000008</name>
Aug 08 23:23:20 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:23:20 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:23:20 user nova-compute[72405]:   <metadata>
Aug 08 23:23:20 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:23:20 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:23:20 user nova-compute[72405]:       <nova:name>tempest-device-tagging-server-714913135</nova:name>
Aug 08 23:23:20 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:23:20</nova:creationTime>
Aug 08 23:23:20 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:23:20 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:23:20 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:23:20 user nova-compute[72405]:       <nova:owner>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:user uuid="d1da7c19e65443d49ebd11d20955166f">tempest-TaggedAttachmentsTest-628633788-project-member</nova:user>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:project uuid="4229ea3198b846819520ed06edf0eecd">tempest-TaggedAttachmentsTest-628633788</nova:project>
Aug 08 23:23:20 user nova-compute[72405]:       </nova:owner>
Aug 08 23:23:20 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:23:20 user nova-compute[72405]:       <nova:ports>
Aug 08 23:23:20 user nova-compute[72405]:         <nova:port uuid="67827618-228c-474c-adaf-4692e1251fc1">
Aug 08 23:23:20 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:23:20 user nova-compute[72405]:         </nova:port>
Aug 08 23:23:20 user nova-compute[72405]:       </nova:ports>
Aug 08 23:23:20 user nova-compute[72405]:     </nova:instance>
Aug 08 23:23:20 user nova-compute[72405]:   </metadata>
Aug 08 23:23:20 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:23:20 user nova-compute[72405]:     <system>
Aug 08 23:23:20 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:23:20 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:23:20 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:23:20 user nova-compute[72405]:       <entry name="serial">29c4e0e6-85dc-4db6-a801-2ff6a19115db</entry>
Aug 08 23:23:20 user nova-compute[72405]:       <entry name="uuid">29c4e0e6-85dc-4db6-a801-2ff6a19115db</entry>
Aug 08 23:23:20 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:23:20 user nova-compute[72405]:     </system>
Aug 08 23:23:20 user nova-compute[72405]:   </sysinfo>
Aug 08 23:23:20 user nova-compute[72405]:   <os>
Aug 08 23:23:20 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:23:20 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:23:20 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:23:20 user nova-compute[72405]:   </os>
Aug 08 23:23:20 user nova-compute[72405]:   <features>
Aug 08 23:23:20 user nova-compute[72405]:     <acpi/>
Aug 08 23:23:20 user nova-compute[72405]:     <apic/>
Aug 08 23:23:20 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:23:20 user nova-compute[72405]:   </features>
Aug 08 23:23:20 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:23:20 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:23:20 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:23:20 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:23:20 user nova-compute[72405]:   </clock>
Aug 08 23:23:20 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:23:20 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:23:20 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:23:20 user nova-compute[72405]:   </cpu>
Aug 08 23:23:20 user nova-compute[72405]:   <devices>
Aug 08 23:23:20 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:23:20 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:23:20 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk"/>
Aug 08 23:23:20 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:23:20 user nova-compute[72405]:     </disk>
Aug 08 23:23:20 user nova-compute[72405]:     <disk type="file" device="cdrom">
Aug 08 23:23:20 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none"/>
Aug 08 23:23:20 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.config"/>
Aug 08 23:23:20 user nova-compute[72405]:       <target dev="hda" bus="ide"/>
Aug 08 23:23:20 user nova-compute[72405]:     </disk>
Aug 08 23:23:20 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:23:20 user nova-compute[72405]:       <mac address="fa:16:3e:b0:85:4a"/>
Aug 08 23:23:20 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:20 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:23:20 user nova-compute[72405]:       <target dev="tap67827618-22"/>
Aug 08 23:23:20 user nova-compute[72405]:     </interface>
Aug 08 23:23:20 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:23:20 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/console.log" append="off"/>
Aug 08 23:23:20 user nova-compute[72405]:     </serial>
Aug 08 23:23:20 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:23:20 user nova-compute[72405]:     <video>
Aug 08 23:23:20 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:20 user nova-compute[72405]:     </video>
Aug 08 23:23:20 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:23:20 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:23:20 user nova-compute[72405]:     </rng>
Aug 08 23:23:20 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:23:20 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:23:20 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:23:20 user nova-compute[72405]:     </memballoon>
Aug 08 23:23:20 user nova-compute[72405]:   </devices>
Aug 08 23:23:20 user nova-compute[72405]: </domain>
Aug 08 23:23:20 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG os_vif [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67827618-22, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67827618-22, col_values=(('external_ids', {'iface-id': '67827618-228c-474c-adaf-4692e1251fc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:85:4a', 'vm-uuid': '29c4e0e6-85dc-4db6-a801-2ff6a19115db'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:20 user nova-compute[72405]: INFO os_vif [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22')
Aug 08 23:23:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No BDM found with device name hda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No VIF found with MAC fa:16:3e:b0:85:4a, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:23:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Using config drive
Aug 08 23:23:20 user nova-compute[72405]: DEBUG nova.policy [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d3f2bd429df4f66ae1d88b134d79709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfc467e1dd844cebc771eecceb0165b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:23:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Creating image(s)
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "/opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "/opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Creating config drive at /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.config
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2oaa_dne {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2oaa_dne" returned: 0 in 0.067s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.184s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk 1073741824" returned: 0 in 0.071s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.network.neutron [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updated VIF entry in instance network info cache for port 67827618-228c-474c-adaf-4692e1251fc1. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.network.neutron [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c2449675-cff4-485d-b153-ebcb227d6cb3 req-56cc957a-17f0-47cb-a324-f0fee1537bfc service nova] Releasing lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Cannot resize image /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lazy-loading 'migration_context' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Ensure instance console log exists: /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:21 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Successfully created port: fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-7f0f8efb-5ffb-4866-aaf1-6175f5d59989 req-90e59a90-5519-4fa9-9eba-d261192b76cb service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7f0f8efb-5ffb-4866-aaf1-6175f5d59989 req-90e59a90-5519-4fa9-9eba-d261192b76cb service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7f0f8efb-5ffb-4866-aaf1-6175f5d59989 req-90e59a90-5519-4fa9-9eba-d261192b76cb service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7f0f8efb-5ffb-4866-aaf1-6175f5d59989 req-90e59a90-5519-4fa9-9eba-d261192b76cb service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-7f0f8efb-5ffb-4866-aaf1-6175f5d59989 req-90e59a90-5519-4fa9-9eba-d261192b76cb service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:22 user nova-compute[72405]: WARNING nova.compute.manager [req-7f0f8efb-5ffb-4866-aaf1-6175f5d59989 req-90e59a90-5519-4fa9-9eba-d261192b76cb service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 for instance with vm_state building and task_state spawning.
Aug 08 23:23:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Successfully updated port: fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquired lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-changed-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Refreshing instance network info cache due to event network-changed-fe0485d2-87fd-4758-a55c-8d8c180a6dee. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] Acquiring lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:23 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updating instance_info_cache with network_info: [{"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Releasing lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Instance network_info: |[{"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] Acquired lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Refreshing network info cache for port fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Start _get_guest_xml network_info=[{"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:23:24 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:24 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-332585741',display_name='tempest-VolumesAssistedSnapshotsTest-server-332585741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-332585741',id=9,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQupi3+JSAvYZ6zaUQN/WOWxwNOudIgaRdjPoaZWVFipuA+sj+aRCcV/HPYTnmAwoXPPnW/6uf/2+DOV9P1NafEWPJbcqUnx/mbt9jTF8xlP+8iDvEezRjPaOWG31IGaA==',key_name='tempest-keypair-1180597893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dfc467e1dd844cebc771eecceb0165b',ramdisk_id='',reservation_id='r-ycflo6vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1098924015',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1098924015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d3f2bd429df4f66ae1d88b134d79709',uuid=6fc8f536-c8af-44f0-91e7-4f68cceb4fdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Converting VIF {"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:23:24 user nova-compute[72405]:   <uuid>6fc8f536-c8af-44f0-91e7-4f68cceb4fdb</uuid>
Aug 08 23:23:24 user nova-compute[72405]:   <name>instance-00000009</name>
Aug 08 23:23:24 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:23:24 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:23:24 user nova-compute[72405]:   <metadata>
Aug 08 23:23:24 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:23:24 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:23:24 user nova-compute[72405]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-332585741</nova:name>
Aug 08 23:23:24 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:23:24</nova:creationTime>
Aug 08 23:23:24 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:23:24 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:23:24 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:23:24 user nova-compute[72405]:       <nova:owner>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:user uuid="7d3f2bd429df4f66ae1d88b134d79709">tempest-VolumesAssistedSnapshotsTest-1098924015-project-member</nova:user>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:project uuid="9dfc467e1dd844cebc771eecceb0165b">tempest-VolumesAssistedSnapshotsTest-1098924015</nova:project>
Aug 08 23:23:24 user nova-compute[72405]:       </nova:owner>
Aug 08 23:23:24 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:23:24 user nova-compute[72405]:       <nova:ports>
Aug 08 23:23:24 user nova-compute[72405]:         <nova:port uuid="fe0485d2-87fd-4758-a55c-8d8c180a6dee">
Aug 08 23:23:24 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 08 23:23:24 user nova-compute[72405]:         </nova:port>
Aug 08 23:23:24 user nova-compute[72405]:       </nova:ports>
Aug 08 23:23:24 user nova-compute[72405]:     </nova:instance>
Aug 08 23:23:24 user nova-compute[72405]:   </metadata>
Aug 08 23:23:24 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:23:24 user nova-compute[72405]:     <system>
Aug 08 23:23:24 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:23:24 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:23:24 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:23:24 user nova-compute[72405]:       <entry name="serial">6fc8f536-c8af-44f0-91e7-4f68cceb4fdb</entry>
Aug 08 23:23:24 user nova-compute[72405]:       <entry name="uuid">6fc8f536-c8af-44f0-91e7-4f68cceb4fdb</entry>
Aug 08 23:23:24 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:23:24 user nova-compute[72405]:     </system>
Aug 08 23:23:24 user nova-compute[72405]:   </sysinfo>
Aug 08 23:23:24 user nova-compute[72405]:   <os>
Aug 08 23:23:24 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:23:24 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:23:24 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:23:24 user nova-compute[72405]:   </os>
Aug 08 23:23:24 user nova-compute[72405]:   <features>
Aug 08 23:23:24 user nova-compute[72405]:     <acpi/>
Aug 08 23:23:24 user nova-compute[72405]:     <apic/>
Aug 08 23:23:24 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:23:24 user nova-compute[72405]:   </features>
Aug 08 23:23:24 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:23:24 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:23:24 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:23:24 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:23:24 user nova-compute[72405]:   </clock>
Aug 08 23:23:24 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:23:24 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:23:24 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:23:24 user nova-compute[72405]:   </cpu>
Aug 08 23:23:24 user nova-compute[72405]:   <devices>
Aug 08 23:23:24 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:23:24 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:23:24 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk"/>
Aug 08 23:23:24 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:23:24 user nova-compute[72405]:     </disk>
Aug 08 23:23:24 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:23:24 user nova-compute[72405]:       <mac address="fa:16:3e:33:4d:d2"/>
Aug 08 23:23:24 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:24 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:23:24 user nova-compute[72405]:       <target dev="tapfe0485d2-87"/>
Aug 08 23:23:24 user nova-compute[72405]:     </interface>
Aug 08 23:23:24 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:23:24 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/console.log" append="off"/>
Aug 08 23:23:24 user nova-compute[72405]:     </serial>
Aug 08 23:23:24 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:23:24 user nova-compute[72405]:     <video>
Aug 08 23:23:24 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:24 user nova-compute[72405]:     </video>
Aug 08 23:23:24 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:23:24 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:23:24 user nova-compute[72405]:     </rng>
Aug 08 23:23:24 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:23:24 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:23:24 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:23:24 user nova-compute[72405]:     </memballoon>
Aug 08 23:23:24 user nova-compute[72405]:   </devices>
Aug 08 23:23:24 user nova-compute[72405]: </domain>
Aug 08 23:23:24 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-332585741',display_name='tempest-VolumesAssistedSnapshotsTest-server-332585741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-332585741',id=9,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQupi3+JSAvYZ6zaUQN/WOWxwNOudIgaRdjPoaZWVFipuA+sj+aRCcV/HPYTnmAwoXPPnW/6uf/2+DOV9P1NafEWPJbcqUnx/mbt9jTF8xlP+8iDvEezRjPaOWG31IGaA==',key_name='tempest-keypair-1180597893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dfc467e1dd844cebc771eecceb0165b',ramdisk_id='',reservation_id='r-ycflo6vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1098924015',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1098924015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d3f2bd429df4f66ae1d88b134d79709',uuid=6fc8f536-c8af-44f0-91e7-4f68cceb4fdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Converting VIF {"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG os_vif [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe0485d2-87, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe0485d2-87, col_values=(('external_ids', {'iface-id': 'fe0485d2-87fd-4758-a55c-8d8c180a6dee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:4d:d2', 'vm-uuid': '6fc8f536-c8af-44f0-91e7-4f68cceb4fdb'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:24 user nova-compute[72405]: INFO os_vif [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87')
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] No VIF found with MAC fa:16:3e:33:4d:d2, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:23:24 user nova-compute[72405]: INFO nova.compute.claims [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Claim successful on node user
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updated VIF entry in instance network info cache for port fe0485d2-87fd-4758-a55c-8d8c180a6dee. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updating instance_info_cache with network_info: [{"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5ad83584-e409-4f22-8be0-9b2ea7e581bd req-c925da18-9416-40ed-bbc1-301baf6c68e0 service nova] Releasing lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-17c3dc81-b5a9-4fee-b13d-6d3c19d51c50 req-7f2032e1-d9fd-48fc-8892-f2b978ab74f4 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-17c3dc81-b5a9-4fee-b13d-6d3c19d51c50 req-7f2032e1-d9fd-48fc-8892-f2b978ab74f4 service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-17c3dc81-b5a9-4fee-b13d-6d3c19d51c50 req-7f2032e1-d9fd-48fc-8892-f2b978ab74f4 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-17c3dc81-b5a9-4fee-b13d-6d3c19d51c50 req-7f2032e1-d9fd-48fc-8892-f2b978ab74f4 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-17c3dc81-b5a9-4fee-b13d-6d3c19d51c50 req-7f2032e1-d9fd-48fc-8892-f2b978ab74f4 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:24 user nova-compute[72405]: WARNING nova.compute.manager [req-17c3dc81-b5a9-4fee-b13d-6d3c19d51c50 req-7f2032e1-d9fd-48fc-8892-f2b978ab74f4 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 for instance with vm_state building and task_state spawning.
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537005.211076, 29c4e0e6-85dc-4db6-a801-2ff6a19115db => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] VM Resumed (Lifecycle Event)
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Instance spawned successfully.
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537005.2112317, 29c4e0e6-85dc-4db6-a801-2ff6a19115db => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] VM Started (Lifecycle Event)
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.policy [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8c422e23cce45cbb2cc478078d340c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae61c745857f4f8ca77b6359d25a43ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Took 7.99 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Skipping network cache update for instance because it is Building. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Skipping network cache update for instance because it is Building. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Skipping network cache update for instance because it is Building. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 1653b9e2-dbff-4620-90d2-b59e612fc3f4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.compute.manager [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Took 8.92 seconds to build instance.
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ebc666e8-f825-4a14-b1f3-4329e75ca112 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.074s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:23:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Creating image(s)
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "/opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "/opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "/opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.198s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk 1073741824" returned: 0 in 0.119s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Successfully created port: 92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.207s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-2916c357-171a-4fcc-9084-f600d195c0c8 req-16b53e1b-c745-49f3-acd6-2c06a164d62f service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2916c357-171a-4fcc-9084-f600d195c0c8 req-16b53e1b-c745-49f3-acd6-2c06a164d62f service nova] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2916c357-171a-4fcc-9084-f600d195c0c8 req-16b53e1b-c745-49f3-acd6-2c06a164d62f service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2916c357-171a-4fcc-9084-f600d195c0c8 req-16b53e1b-c745-49f3-acd6-2c06a164d62f service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-2916c357-171a-4fcc-9084-f600d195c0c8 req-16b53e1b-c745-49f3-acd6-2c06a164d62f service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] No waiting events found dispatching network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:26 user nova-compute[72405]: WARNING nova.compute.manager [req-2916c357-171a-4fcc-9084-f600d195c0c8 req-16b53e1b-c745-49f3-acd6-2c06a164d62f service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received unexpected event network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee for instance with vm_state building and task_state spawning.
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Cannot resize image /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.objects.instance [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lazy-loading 'migration_context' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Ensure instance console log exists: /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updating instance_info_cache with network_info: [{"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-1653b9e2-dbff-4620-90d2-b59e612fc3f4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:26 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Successfully updated port: 92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquired lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-changed-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Refreshing instance network info cache due to event network-changed-92830d91-3d6e-44a6-98fa-048cc0b5d459. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] Acquiring lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.network.neutron [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updating instance_info_cache with network_info: [{"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Releasing lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Instance network_info: |[{"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] Acquired lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.network.neutron [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Refreshing network info cache for port 92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Start _get_guest_xml network_info=[{"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:28 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:28 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1483665552',display_name='tempest-TestVolumeSwap-server-1483665552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1483665552',id=10,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgKJIQgI/c2nArGmWPDTB1wzJzYuztaj/5Vf3zXUZtXoU1mHTiVyceJfKhTDTCMIjeTWHFtYJeHz7onMucW/mdqAIGFPJWaenZ1IqqNg7B6LFkkr44ZPKMoPZ6l2YI7AA==',key_name='tempest-keypair-673977697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae61c745857f4f8ca77b6359d25a43ee',ramdisk_id='',reservation_id='r-uxtbzltd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2102136752',owner_user_name='tempest-TestVolumeSwap-2102136752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8c422e23cce45cbb2cc478078d340c9',uuid=760574b8-2c65-4bb3-9ea6-1462bd32774b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Converting VIF {"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lazy-loading 'pci_devices' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:23:28 user nova-compute[72405]:   <uuid>760574b8-2c65-4bb3-9ea6-1462bd32774b</uuid>
Aug 08 23:23:28 user nova-compute[72405]:   <name>instance-0000000a</name>
Aug 08 23:23:28 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:23:28 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:23:28 user nova-compute[72405]:   <metadata>
Aug 08 23:23:28 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:23:28 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:23:28 user nova-compute[72405]:       <nova:name>tempest-TestVolumeSwap-server-1483665552</nova:name>
Aug 08 23:23:28 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:23:28</nova:creationTime>
Aug 08 23:23:28 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:23:28 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:23:28 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:23:28 user nova-compute[72405]:       <nova:owner>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:user uuid="b8c422e23cce45cbb2cc478078d340c9">tempest-TestVolumeSwap-2102136752-project-member</nova:user>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:project uuid="ae61c745857f4f8ca77b6359d25a43ee">tempest-TestVolumeSwap-2102136752</nova:project>
Aug 08 23:23:28 user nova-compute[72405]:       </nova:owner>
Aug 08 23:23:28 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:23:28 user nova-compute[72405]:       <nova:ports>
Aug 08 23:23:28 user nova-compute[72405]:         <nova:port uuid="92830d91-3d6e-44a6-98fa-048cc0b5d459">
Aug 08 23:23:28 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 08 23:23:28 user nova-compute[72405]:         </nova:port>
Aug 08 23:23:28 user nova-compute[72405]:       </nova:ports>
Aug 08 23:23:28 user nova-compute[72405]:     </nova:instance>
Aug 08 23:23:28 user nova-compute[72405]:   </metadata>
Aug 08 23:23:28 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:23:28 user nova-compute[72405]:     <system>
Aug 08 23:23:28 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:23:28 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:23:28 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:23:28 user nova-compute[72405]:       <entry name="serial">760574b8-2c65-4bb3-9ea6-1462bd32774b</entry>
Aug 08 23:23:28 user nova-compute[72405]:       <entry name="uuid">760574b8-2c65-4bb3-9ea6-1462bd32774b</entry>
Aug 08 23:23:28 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:23:28 user nova-compute[72405]:     </system>
Aug 08 23:23:28 user nova-compute[72405]:   </sysinfo>
Aug 08 23:23:28 user nova-compute[72405]:   <os>
Aug 08 23:23:28 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:23:28 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:23:28 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:23:28 user nova-compute[72405]:   </os>
Aug 08 23:23:28 user nova-compute[72405]:   <features>
Aug 08 23:23:28 user nova-compute[72405]:     <acpi/>
Aug 08 23:23:28 user nova-compute[72405]:     <apic/>
Aug 08 23:23:28 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:23:28 user nova-compute[72405]:   </features>
Aug 08 23:23:28 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:23:28 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:23:28 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:23:28 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:23:28 user nova-compute[72405]:   </clock>
Aug 08 23:23:28 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:23:28 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:23:28 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:23:28 user nova-compute[72405]:   </cpu>
Aug 08 23:23:28 user nova-compute[72405]:   <devices>
Aug 08 23:23:28 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:23:28 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:23:28 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk"/>
Aug 08 23:23:28 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:23:28 user nova-compute[72405]:     </disk>
Aug 08 23:23:28 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:23:28 user nova-compute[72405]:       <mac address="fa:16:3e:b6:36:de"/>
Aug 08 23:23:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:28 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:23:28 user nova-compute[72405]:       <target dev="tap92830d91-3d"/>
Aug 08 23:23:28 user nova-compute[72405]:     </interface>
Aug 08 23:23:28 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:23:28 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/console.log" append="off"/>
Aug 08 23:23:28 user nova-compute[72405]:     </serial>
Aug 08 23:23:28 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:23:28 user nova-compute[72405]:     <video>
Aug 08 23:23:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:28 user nova-compute[72405]:     </video>
Aug 08 23:23:28 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:23:28 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:23:28 user nova-compute[72405]:     </rng>
Aug 08 23:23:28 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:23:28 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:23:28 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:23:28 user nova-compute[72405]:     </memballoon>
Aug 08 23:23:28 user nova-compute[72405]:   </devices>
Aug 08 23:23:28 user nova-compute[72405]: </domain>
Aug 08 23:23:28 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1483665552',display_name='tempest-TestVolumeSwap-server-1483665552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1483665552',id=10,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgKJIQgI/c2nArGmWPDTB1wzJzYuztaj/5Vf3zXUZtXoU1mHTiVyceJfKhTDTCMIjeTWHFtYJeHz7onMucW/mdqAIGFPJWaenZ1IqqNg7B6LFkkr44ZPKMoPZ6l2YI7AA==',key_name='tempest-keypair-673977697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae61c745857f4f8ca77b6359d25a43ee',ramdisk_id='',reservation_id='r-uxtbzltd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2102136752',owner_user_name='tempest-TestVolumeSwap-2102136752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8c422e23cce45cbb2cc478078d340c9',uuid=760574b8-2c65-4bb3-9ea6-1462bd32774b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Converting VIF {"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG os_vif [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92830d91-3d, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92830d91-3d, col_values=(('external_ids', {'iface-id': '92830d91-3d6e-44a6-98fa-048cc0b5d459', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:36:de', 'vm-uuid': '760574b8-2c65-4bb3-9ea6-1462bd32774b'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:28 user nova-compute[72405]: INFO os_vif [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d')
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537008.5915582, 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] VM Resumed (Lifecycle Event)
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:28 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Instance spawned successfully.
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] No VIF found with MAC fa:16:3e:b6:36:de, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537008.5916567, 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] VM Started (Lifecycle Event)
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-2487600d-b075-4bd4-bc65-2f7d668ad01b req-197496bc-6d0a-49d5-9fd0-93c1401d6c00 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2487600d-b075-4bd4-bc65-2f7d668ad01b req-197496bc-6d0a-49d5-9fd0-93c1401d6c00 service nova] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2487600d-b075-4bd4-bc65-2f7d668ad01b req-197496bc-6d0a-49d5-9fd0-93c1401d6c00 service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2487600d-b075-4bd4-bc65-2f7d668ad01b req-197496bc-6d0a-49d5-9fd0-93c1401d6c00 service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-2487600d-b075-4bd4-bc65-2f7d668ad01b req-197496bc-6d0a-49d5-9fd0-93c1401d6c00 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] No waiting events found dispatching network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:28 user nova-compute[72405]: WARNING nova.compute.manager [req-2487600d-b075-4bd4-bc65-2f7d668ad01b req-197496bc-6d0a-49d5-9fd0-93c1401d6c00 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received unexpected event network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee for instance with vm_state building and task_state spawning.
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:28 user nova-compute[72405]: INFO nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Took 7.88 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:29 user nova-compute[72405]: INFO nova.compute.manager [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Took 8.95 seconds to build instance.
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0ed47df-d227-4ab8-bbea-682f2be54c4a tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.167s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updated VIF entry in instance network info cache for port 92830d91-3d6e-44a6-98fa-048cc0b5d459. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updating instance_info_cache with network_info: [{"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6df7a03-dacb-48ef-8c7f-ad007b86f401 req-d5d5ed65-64f5-403c-9d47-42e7cd9ed2f1 service nova] Releasing lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-65b88a0f-65c6-4de8-be68-d10a6cc9b3ad req-1d355da2-5fce-4079-9f8e-452292acc18a service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-65b88a0f-65c6-4de8-be68-d10a6cc9b3ad req-1d355da2-5fce-4079-9f8e-452292acc18a service nova] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-65b88a0f-65c6-4de8-be68-d10a6cc9b3ad req-1d355da2-5fce-4079-9f8e-452292acc18a service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-65b88a0f-65c6-4de8-be68-d10a6cc9b3ad req-1d355da2-5fce-4079-9f8e-452292acc18a service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-65b88a0f-65c6-4de8-be68-d10a6cc9b3ad req-1d355da2-5fce-4079-9f8e-452292acc18a service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] No waiting events found dispatching network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:30 user nova-compute[72405]: WARNING nova.compute.manager [req-65b88a0f-65c6-4de8-be68-d10a6cc9b3ad req-1d355da2-5fce-4079-9f8e-452292acc18a service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received unexpected event network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 for instance with vm_state building and task_state spawning.
Aug 08 23:23:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537013.002326, 760574b8-2c65-4bb3-9ea6-1462bd32774b => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] VM Resumed (Lifecycle Event)
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-87908528-64f2-47dc-9d10-c60017b137d5 req-d46ca717-502d-4aa6-8ade-1cae002a0e04 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87908528-64f2-47dc-9d10-c60017b137d5 req-d46ca717-502d-4aa6-8ade-1cae002a0e04 service nova] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87908528-64f2-47dc-9d10-c60017b137d5 req-d46ca717-502d-4aa6-8ade-1cae002a0e04 service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87908528-64f2-47dc-9d10-c60017b137d5 req-d46ca717-502d-4aa6-8ade-1cae002a0e04 service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-87908528-64f2-47dc-9d10-c60017b137d5 req-d46ca717-502d-4aa6-8ade-1cae002a0e04 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] No waiting events found dispatching network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:33 user nova-compute[72405]: WARNING nova.compute.manager [req-87908528-64f2-47dc-9d10-c60017b137d5 req-d46ca717-502d-4aa6-8ade-1cae002a0e04 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received unexpected event network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 for instance with vm_state building and task_state spawning.
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Instance spawned successfully.
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:33 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:33 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.7794189453125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537013.0036204, 760574b8-2c65-4bb3-9ea6-1462bd32774b => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] VM Started (Lifecycle Event)
Aug 08 23:23:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Took 7.82 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:33 user nova-compute[72405]: INFO nova.compute.manager [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Took 9.09 seconds to build instance.
Aug 08 23:23:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cd4e8366-4b5d-419a-ab3e-374400420360 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.316s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 1653b9e2-dbff-4620-90d2-b59e612fc3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 139270d7-7024-4397-a005-618e17165718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 760574b8-2c65-4bb3-9ea6-1462bd32774b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:23:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:23:34 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:34 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:34 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:23:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.907s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:38 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:23:38 user nova-compute[72405]: INFO nova.compute.claims [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Claim successful on node user
Aug 08 23:23:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:23:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:23:39 user nova-compute[72405]: DEBUG nova.policy [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0bf5d8840da4cf6b94c2b86218e56b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0a5ebefd74f72810befd87bf0555e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:23:39 user nova-compute[72405]: INFO nova.virt.block_device [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Booting with volume 71eafcd6-2945-46a2-b22c-7e20d018c7a5 at /dev/vda
Aug 08 23:23:39 user nova-compute[72405]: DEBUG os_brick.utils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:23:39 user nova-compute[72405]: INFO oslo.privsep.daemon [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpx_f7l09f/privsep.sock']
Aug 08 23:23:39 user sudo[83316]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpx_f7l09f/privsep.sock
Aug 08 23:23:39 user sudo[83316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 08 23:23:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Successfully created port: 9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Successfully updated port: 9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquired lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-changed-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Refreshing instance network info cache due to event network-changed-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] Acquiring lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updating instance_info_cache with network_info: [{"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Releasing lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance network_info: |[{"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] Acquired lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Refreshing network info cache for port 9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:23:41 user sudo[83316]: pam_unix(sudo:session): session closed for user root
Aug 08 23:23:41 user nova-compute[72405]: INFO oslo.privsep.daemon [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Spawned new privsep daemon via rootwrap
Aug 08 23:23:41 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 08 23:23:41 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 08 23:23:41 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 08 23:23:41 user nova-compute[72405]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83323
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1348ed86-89f3-4a94-9af5-2dfc6f4ec0c6]: (2,) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b24e501-9bef-47d3-a310-41608956b8b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:41 user nova-compute[72405]: WARNING os_brick.initiator.connectors.nvmeof [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab7ed8-956f-4336-82b3-64ed4c7f9a33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11ac8e-0f8b-4ae5-878d-a65f0feffdae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e203a3-47f9-4f24-af61-299138dcf920]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:23:41 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:23:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e6d2ed-0982-4d16-8b17-1597e17af1ef]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG os_brick.utils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== get_connector_properties: return (2342ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:23:41 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updating existing volume attachment record: 7894aec2-6659-43e4-9052-b41605f47931 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:23:42 user nova-compute[72405]: DEBUG nova.network.neutron [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updated VIF entry in instance network info cache for port 9b7b490f-5f0c-4df2-b016-5f494f3b0b3a. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:23:42 user nova-compute[72405]: DEBUG nova.network.neutron [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updating instance_info_cache with network_info: [{"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:23:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b06dc1be-6436-4547-8279-f9178606e84e req-7c2dcf17-f818-430e-8ad3-0ccf2e05c087 service nova] Releasing lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:23:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:23:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Creating image(s)
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Ensure instance console log exists: /opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Start _get_guest_xml network_info=[{"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7894aec2-6659-43e4-9052-b41605f47931', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '330c761e-bda2-45ac-8731-fe511b40624c', 'attached_at': '', 'detached_at': '', 'volume_id': '71eafcd6-2945-46a2-b22c-7e20d018c7a5', 'serial': '71eafcd6-2945-46a2-b22c-7e20d018c7a5'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:23:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connector [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Factory for ISCSI on None {{(pid=72405) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:23:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:23:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:23:50 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2c63ee-d96d-4777-b443-c8ac21e7fa0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:23:50 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8149c-a9eb-4394-9463-df92058fdb11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5] added
Aug 08 23:23:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a561b8-f7c1-4b1e-b18b-3388c0d97e8e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5ed476-f4a0-439e-af7c-8702db2c94c9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaSuXHCP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaSuXHCP" returned: 0 in 0.055s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[69337948-3114-4dc3-a939-9d63f34360ae]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaSuXHCP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b3bcfc-df5f-41ee-8f6e-5d01041617f2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[144430d6-f979-4410-910e-d34680a313ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:23:50 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:23:50 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:23:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 08 23:23:50 user nova-compute[72405]: 
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c43cc46-8606-4560-8d11-398a87dc7eb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]
Aug 08 23:23:50 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.
Aug 08 23:23:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e87a659-7c12-4c27-b7d2-b70dc5777dde]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a58123-ecb3-4238-96c4-09307aa77860]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:23:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:23:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e286b7ad-3da3-475d-b8bc-e8931657add3]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:23:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23065333635326238', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065333635326238', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-674469148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-674469148',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2/Tv+b0uztkXHMREr0UP8T0i6R/8JrjK1hb5/JEax3JDtvpPQmo4hkEAoigmfGRTl79Pw59QXqqVHqBZYXTbZQ9o/acWpERhf3mjn3D88m8ZJHZVoYA1j9Wo3IojtHjw==',key_name='tempest-keypair-861392922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21f0a5ebefd74f72810befd87bf0555e',ramdisk_id='',reservation_id='r-wzbbfqxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1828337581',owner_user_name='tempest-ServerActionsV293TestJSON-1828337581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0bf5d8840da4cf6b94c2b86218e56b2',uuid=330c761e-bda2-45ac-8731-fe511b40624c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converting VIF {"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'pci_devices' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:23:51 user nova-compute[72405]:   <uuid>330c761e-bda2-45ac-8731-fe511b40624c</uuid>
Aug 08 23:23:51 user nova-compute[72405]:   <name>instance-0000000b</name>
Aug 08 23:23:51 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:23:51 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:23:51 user nova-compute[72405]:   <metadata>
Aug 08 23:23:51 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:23:51 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:23:51 user nova-compute[72405]:       <nova:name>tempest-ServerActionsV293TestJSON-server-674469148</nova:name>
Aug 08 23:23:51 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:23:50</nova:creationTime>
Aug 08 23:23:51 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:23:51 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:23:51 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:23:51 user nova-compute[72405]:       <nova:owner>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:user uuid="f0bf5d8840da4cf6b94c2b86218e56b2">tempest-ServerActionsV293TestJSON-1828337581-project-member</nova:user>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:project uuid="21f0a5ebefd74f72810befd87bf0555e">tempest-ServerActionsV293TestJSON-1828337581</nova:project>
Aug 08 23:23:51 user nova-compute[72405]:       </nova:owner>
Aug 08 23:23:51 user nova-compute[72405]:       <nova:ports>
Aug 08 23:23:51 user nova-compute[72405]:         <nova:port uuid="9b7b490f-5f0c-4df2-b016-5f494f3b0b3a">
Aug 08 23:23:51 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:23:51 user nova-compute[72405]:         </nova:port>
Aug 08 23:23:51 user nova-compute[72405]:       </nova:ports>
Aug 08 23:23:51 user nova-compute[72405]:     </nova:instance>
Aug 08 23:23:51 user nova-compute[72405]:   </metadata>
Aug 08 23:23:51 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:23:51 user nova-compute[72405]:     <system>
Aug 08 23:23:51 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:23:51 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:23:51 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:23:51 user nova-compute[72405]:       <entry name="serial">330c761e-bda2-45ac-8731-fe511b40624c</entry>
Aug 08 23:23:51 user nova-compute[72405]:       <entry name="uuid">330c761e-bda2-45ac-8731-fe511b40624c</entry>
Aug 08 23:23:51 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:23:51 user nova-compute[72405]:     </system>
Aug 08 23:23:51 user nova-compute[72405]:   </sysinfo>
Aug 08 23:23:51 user nova-compute[72405]:   <os>
Aug 08 23:23:51 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:23:51 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:23:51 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:23:51 user nova-compute[72405]:   </os>
Aug 08 23:23:51 user nova-compute[72405]:   <features>
Aug 08 23:23:51 user nova-compute[72405]:     <acpi/>
Aug 08 23:23:51 user nova-compute[72405]:     <apic/>
Aug 08 23:23:51 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:23:51 user nova-compute[72405]:   </features>
Aug 08 23:23:51 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:23:51 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:23:51 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:23:51 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:23:51 user nova-compute[72405]:   </clock>
Aug 08 23:23:51 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:23:51 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:23:51 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:23:51 user nova-compute[72405]:   </cpu>
Aug 08 23:23:51 user nova-compute[72405]:   <devices>
Aug 08 23:23:51 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:23:51 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:23:51 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:23:51 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:23:51 user nova-compute[72405]:       <serial>71eafcd6-2945-46a2-b22c-7e20d018c7a5</serial>
Aug 08 23:23:51 user nova-compute[72405]:     </disk>
Aug 08 23:23:51 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:23:51 user nova-compute[72405]:       <mac address="fa:16:3e:dd:bb:19"/>
Aug 08 23:23:51 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:51 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:23:51 user nova-compute[72405]:       <target dev="tap9b7b490f-5f"/>
Aug 08 23:23:51 user nova-compute[72405]:     </interface>
Aug 08 23:23:51 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:23:51 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c/console.log" append="off"/>
Aug 08 23:23:51 user nova-compute[72405]:     </serial>
Aug 08 23:23:51 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:23:51 user nova-compute[72405]:     <video>
Aug 08 23:23:51 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:23:51 user nova-compute[72405]:     </video>
Aug 08 23:23:51 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:23:51 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:23:51 user nova-compute[72405]:     </rng>
Aug 08 23:23:51 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:23:51 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:23:51 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:23:51 user nova-compute[72405]:     </memballoon>
Aug 08 23:23:51 user nova-compute[72405]:   </devices>
Aug 08 23:23:51 user nova-compute[72405]: </domain>
Aug 08 23:23:51 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-674469148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-674469148',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2/Tv+b0uztkXHMREr0UP8T0i6R/8JrjK1hb5/JEax3JDtvpPQmo4hkEAoigmfGRTl79Pw59QXqqVHqBZYXTbZQ9o/acWpERhf3mjn3D88m8ZJHZVoYA1j9Wo3IojtHjw==',key_name='tempest-keypair-861392922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21f0a5ebefd74f72810befd87bf0555e',ramdisk_id='',reservation_id='r-wzbbfqxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1828337581',owner_user_name='tempest-ServerActionsV293TestJSON-1828337581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0bf5d8840da4cf6b94c2b86218e56b2',uuid=330c761e-bda2-45ac-8731-fe511b40624c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converting VIF {"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG os_vif [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b7b490f-5f, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b7b490f-5f, col_values=(('external_ids', {'iface-id': '9b7b490f-5f0c-4df2-b016-5f494f3b0b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:bb:19', 'vm-uuid': '330c761e-bda2-45ac-8731-fe511b40624c'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:51 user nova-compute[72405]: INFO os_vif [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f')
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:23:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] No VIF found with MAC fa:16:3e:dd:bb:19, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:23:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-301cacfa-d8af-4b5b-9564-10bb69812746 req-dc98bfcb-b8a4-48eb-a186-c06bb7ee5da9 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-301cacfa-d8af-4b5b-9564-10bb69812746 req-dc98bfcb-b8a4-48eb-a186-c06bb7ee5da9 service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-301cacfa-d8af-4b5b-9564-10bb69812746 req-dc98bfcb-b8a4-48eb-a186-c06bb7ee5da9 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-301cacfa-d8af-4b5b-9564-10bb69812746 req-dc98bfcb-b8a4-48eb-a186-c06bb7ee5da9 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-301cacfa-d8af-4b5b-9564-10bb69812746 req-dc98bfcb-b8a4-48eb-a186-c06bb7ee5da9 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:53 user nova-compute[72405]: WARNING nova.compute.manager [req-301cacfa-d8af-4b5b-9564-10bb69812746 req-dc98bfcb-b8a4-48eb-a186-c06bb7ee5da9 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state building and task_state spawning.
Aug 08 23:23:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537034.9159636, 330c761e-bda2-45ac-8731-fe511b40624c => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:54 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] VM Resumed (Lifecycle Event)
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:23:54 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance spawned successfully.
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:23:54 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:54 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537034.922611, 330c761e-bda2-45ac-8731-fe511b40624c => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:23:54 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] VM Started (Lifecycle Event)
Aug 08 23:23:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:23:55 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:23:55 user nova-compute[72405]: INFO nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 08 23:23:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:23:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-a1949d2e-bb08-4909-8acc-db40078273cd req-3c82ce29-ad3d-4fce-866e-77fe41a7c2cd service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:23:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a1949d2e-bb08-4909-8acc-db40078273cd req-3c82ce29-ad3d-4fce-866e-77fe41a7c2cd service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:23:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a1949d2e-bb08-4909-8acc-db40078273cd req-3c82ce29-ad3d-4fce-866e-77fe41a7c2cd service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:23:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a1949d2e-bb08-4909-8acc-db40078273cd req-3c82ce29-ad3d-4fce-866e-77fe41a7c2cd service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-a1949d2e-bb08-4909-8acc-db40078273cd req-3c82ce29-ad3d-4fce-866e-77fe41a7c2cd service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:23:55 user nova-compute[72405]: WARNING nova.compute.manager [req-a1949d2e-bb08-4909-8acc-db40078273cd req-3c82ce29-ad3d-4fce-866e-77fe41a7c2cd service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state building and task_state spawning.
Aug 08 23:23:55 user nova-compute[72405]: INFO nova.compute.manager [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Took 16.68 seconds to build instance.
Aug 08 23:23:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-83987971-58b7-42e0-b669-834aad3a9de2 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.800s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:23:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:23:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:24:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:24:00 user nova-compute[72405]: INFO nova.compute.claims [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Claim successful on node user
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:24:01 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:24:01 user nova-compute[72405]: INFO nova.virt.block_device [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Booting with volume a392004b-3893-4731-9eb1-a22dc1d73ad7 at /dev/vda
Aug 08 23:24:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.policy [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31a4c9aa56b44b3fa831e7d6ab99ff5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c6177572d644cfa81eee95c9b6cb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG os_brick.utils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13adfc-19af-4cc0-a38e-3deba2b8265a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[925308d9-95a3-4b43-9368-48e3b8a0c3d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a77b44-d23a-41bb-b1b2-b3ee733667ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4c13fe-d10b-4d0a-9695-52b53eed4f25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:01 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a65a6-79f1-4fa5-9395-46635a78f87c]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG os_brick.utils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:01 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating existing volume attachment record: ab31d79e-0af8-4cc2-84eb-64a32fceadc5 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully created port: 94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:24:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully created port: 9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:24:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully created port: 80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:24:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully created port: 6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:24:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully created port: 8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: 94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-94100f59-cac9-428d-8e61-74b20c90d6f3. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: 7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:06 user nova-compute[72405]: DEBUG nova.network.neutron [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-95e03cdf-92cc-493d-9c5c-e6453a74d940 req-3b50c846-5e39-45de-925b-194c16aabec4 service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-7782ca35-8361-436f-a2e4-76f0a66bb15a. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: 9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-e0af855a-8881-4ce7-99f5-40df76bd1c80. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a387d527-09b0-4fcf-a383-408ae68f24bd req-04123d46-abc4-4cdf-b97f-30a3d54d4808 service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: 80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: 6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-9ffbae4e-e1a9-46eb-9e94-d7221788880f. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-80db08a8-2674-4568-a637-0edc4d110763. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Successfully updated port: 8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-6eb9b413-72dc-4187-8470-126b1106e523. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6f6b69d1-f9d1-4984-8014-e02837ffec78 req-4db36966-c5e8-4219-ba70-d3b30e6de7cb service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:24:10 user nova-compute[72405]: INFO nova.virt.block_device [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Booting with volume f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 at /dev/vdb
Aug 08 23:24:10 user nova-compute[72405]: DEBUG os_brick.utils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[47809908-320b-4ee0-8b0d-28b319f7d815]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb3855-c111-45c9-a080-9a03a7fe417e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b8926-534b-4450-8275-9c81488f166b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a98b8d8-076f-453d-b6b8-1ff386bed932]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:10 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b156f95-0660-4832-91a5-3b975e36f8a2]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG os_brick.utils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:10 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating existing volume attachment record: 5120503c-dcca-4bcd-a091-863953fd95fb {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-8ded0468-3c34-48c4-b84b-af969b3ba3ca. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance network_info: |[{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updated VIF entry in instance network info cache for port 8ded0468-3c34-48c4-b84b-af969b3ba3ca. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1768dbe9-27e2-4218-87ec-ec3c28697396 req-a82670bb-86d5-46b9-b5c0-cafaae9ba146 service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:18 user nova-compute[72405]: INFO nova.virt.block_device [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Booting with volume 1e9ace62-0227-4746-af80-87313f305f95 at /dev/vdc
Aug 08 23:24:18 user nova-compute[72405]: DEBUG os_brick.utils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccefb3-faeb-49da-bf9b-ce86cf51e383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[257adc44-ede2-4459-b633-bc4febd9e9e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e069f990-6bb9-47d8-a828-661379ec0162]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f944a08-0cdc-4143-b99d-9fdfd9c6ae4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:18 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7b7e3b-61d3-4adf-9f68-f7219e7e88f1]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG os_brick.utils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:18 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating existing volume attachment record: 7ef45bfb-c447-4e54-9793-413c6f1ed8ef {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:24:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:24:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:24:29 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Creating image(s)
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Ensure instance console log exists: /opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Start _get_guest_xml network_info=[{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ab31d79e-0af8-4cc2-84eb-64a32fceadc5', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KstjgwuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a392004b-3893-4731-9eb1-a22dc1d73ad7', 'serial': 'a392004b-3893-4731-9eb1-a22dc1d73ad7'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '5120503c-dcca-4bcd-a091-863953fd95fb', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FczXatSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20', 'serial': 'f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20'}, 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '7ef45bfb-c447-4e54-9793-413c6f1ed8ef', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajTnglEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2', 'attached_at': '', 'detached_at': '', 'volume_id': '1e9ace62-0227-4746-af80-87313f305f95', 'serial': '1e9ace62-0227-4746-af80-87313f305f95'}, 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:24:29 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:24:29 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KstjgwuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:29 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:29 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:29 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c00610-935b-4bff-90f7-9641494703ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:24:29 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f64a63-d4e6-47b7-997f-22ca6bf97e0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7] added
Aug 08 23:24:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090fef4-0d27-4b6a-90cd-cf71d233a3e2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a337aac-da82-44a1-a1eb-77da78f1d53d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KstjgwuC {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KstjgwuC" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e843df-9d38-44e0-b568-76ac2cbead75]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KstjgwuC'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e83a331-8315-4ca3-9673-a25cbc41dc0e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88f2b08-da18-41a4-8518-1b69d3a68b2b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d599a9d-ba17-4641-90e5-a2944e472c3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260]
Aug 08 23:24:29 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc143db-24b1-4741-9c7d-c86f122b4209]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75d80e-4fca-4a8d-9fe9-70dfbd8555df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:29 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:29 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f7da1e-8e90-424a-9131-45e57860f5e3]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KstjgwuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lazy-loading 'flavor' on Instance uuid 1653b9e2-dbff-4620-90d2-b59e612fc3f4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:30 user nova-compute[72405]: INFO nova.compute.manager [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] instance snapshotting
Aug 08 23:24:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Beginning live snapshot process
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:30 user nova-compute[72405]: INFO nova.compute.manager [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Attaching volume 7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 to /dev/vdb
Aug 08 23:24:30 user nova-compute[72405]: DEBUG os_brick.utils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8c7d3b-6685-4e3f-b16f-8d643b6f42d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce3917-afed-4e49-b37a-0f7dde774329]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838298c-1cff-47b1-8bce-7a77c05f9979]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cb0404-13d1-4dbb-9329-ac36ebf2db30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:30 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf278b-ccc3-48a1-a476-f54690334e45]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG os_brick.utils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] <== get_connector_properties: return (212ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updating existing volume attachment record: 577ca6b7-d5a9-45eb-ba3b-02e945cbcc8d {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-changed-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Refreshing instance network info cache due to event network-changed-8654907e-9844-4cf4-8754-5b540b3aa53c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Refreshing network info cache for port 8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.663s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== connect_volume: return (1664ms) {'type': 'block', 'scsi_wwn': '23730353038316433', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353038316433', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json -f qcow2" returned: 0 in 0.582s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:24:31 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=6683MB free_disk=25.646068572998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FczXatSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:31 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:31 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:31 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f111a73d-d13a-47ad-b972-8e46ede73913]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:24:31 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c53931-1932-42c4-ba7c-edf7605a9e8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20] added
Aug 08 23:24:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bab702-6727-435a-a9e4-2f5a12d1c64e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c543c-3dba-43b9-bbcc-42d1342e3067]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 1653b9e2-dbff-4620-90d2-b59e612fc3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 139270d7-7024-4397-a005-618e17165718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 760574b8-2c65-4bb3-9ea6-1462bd32774b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 330c761e-bda2-45ac-8731-fe511b40624c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FczXatSW {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FczXatSW" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63f4f0-efc0-4586-8cae-8ae54f0aa2df]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FczXatSW'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e63ad53-6a85-4658-b71a-339ea31a1e16]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[47813749-4093-4c22-ba85-744dedb008d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppqvvwbrx/03deee97887446918c6aaff9f4632a03.delta 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[85def3cc-243f-4f59-a693-2a48d4fa14df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260]
Aug 08 23:24:31 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppqvvwbrx/03deee97887446918c6aaff9f4632a03.delta 1073741824" returned: 0 in 0.070s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72405) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 08 23:24:31 user nova-compute[72405]: INFO nova.virt.libvirt.host [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] UEFI support detected
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce633eda-dfa1-4a84-9df3-b095f0af3366]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e96f3b3-1550-4203-8d88-ef95c035d3c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2136ca58-3efe-470b-8aa3-1f19e369176d]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FczXatSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:24:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.network.neutron [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updated VIF entry in instance network info cache for port 8654907e-9844-4cf4-8754-5b540b3aa53c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.network.neutron [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3ba5b5aa-72de-4f24-9576-db7179889b6c req-ebc46552-b03a-40be-9f34-0f52418bb178 service nova] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23634336439353238', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634336439353238', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajTnglEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:32 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:32 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:32 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ea9fd-05ed-45fe-a8c7-1b26d647d605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:24:32 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ce73f-e76e-4547-9744-52cc37f19692]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95] added
Aug 08 23:24:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c24147-53ea-4c6b-8d05-79ba433737a0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:24:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9047c0d-9842-4d8d-988b-a0d45f172871]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajTnglEV {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajTnglEV" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12128416-5f1b-410f-8005-409014f486e4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajTnglEV'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[298aa82e-39a0-492c-9403-f294cfb0243d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:24:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppqvvwbrx/03deee97887446918c6aaff9f4632a03.delta /opt/stack/data/nova/instances/snapshots/tmppqvvwbrx/03deee97887446918c6aaff9f4632a03 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea37ace-83df-42be-8636-a297d4893f55]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3aea0a-ef6a-4eb6-85d0-4bee05410e05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260]
Aug 08 23:24:33 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.093s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4371b-cbec-4498-bf17-4894b4c6ade9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfcc3a-23b8-4c35-96a1-ef6bb3089163]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4178fed-34ce-4319-9ec6-2c8851d0e087]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajTnglEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:24:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppqvvwbrx/03deee97887446918c6aaff9f4632a03.delta /opt/stack/data/nova/instances/snapshots/tmppqvvwbrx/03deee97887446918c6aaff9f4632a03" returned: 0 in 0.726s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Snapshot extracted, beginning image upload
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '26639346332366437', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639346332366437', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lazy-loading 'pci_devices' on Instance uuid c3d07e7d-a00e-4a8b-81e3-902cf007cde2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:24:34 user nova-compute[72405]:   <uuid>c3d07e7d-a00e-4a8b-81e3-902cf007cde2</uuid>
Aug 08 23:24:34 user nova-compute[72405]:   <name>instance-0000000c</name>
Aug 08 23:24:34 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:24:34 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:24:34 user nova-compute[72405]:   <metadata>
Aug 08 23:24:34 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:24:34 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:24:34 user nova-compute[72405]:       <nova:name>tempest-device-tagging-server-1313177768</nova:name>
Aug 08 23:24:34 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:24:29</nova:creationTime>
Aug 08 23:24:34 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:24:34 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:24:34 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:24:34 user nova-compute[72405]:       <nova:owner>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:user uuid="31a4c9aa56b44b3fa831e7d6ab99ff5e">tempest-TaggedBootDevicesTest-1825716698-project-member</nova:user>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:project uuid="66c6177572d644cfa81eee95c9b6cb5b">tempest-TaggedBootDevicesTest-1825716698</nova:project>
Aug 08 23:24:34 user nova-compute[72405]:       </nova:owner>
Aug 08 23:24:34 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:24:34 user nova-compute[72405]:       <nova:ports>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="94100f59-cac9-428d-8e61-74b20c90d6f3">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="7782ca35-8361-436f-a2e4-76f0a66bb15a">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="e0af855a-8881-4ce7-99f5-40df76bd1c80">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.46" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="9ffbae4e-e1a9-46eb-9e94-d7221788880f">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="80db08a8-2674-4568-a637-0edc4d110763">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="6eb9b413-72dc-4187-8470-126b1106e523">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:         <nova:port uuid="8ded0468-3c34-48c4-b84b-af969b3ba3ca">
Aug 08 23:24:34 user nova-compute[72405]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 08 23:24:34 user nova-compute[72405]:         </nova:port>
Aug 08 23:24:34 user nova-compute[72405]:       </nova:ports>
Aug 08 23:24:34 user nova-compute[72405]:     </nova:instance>
Aug 08 23:24:34 user nova-compute[72405]:   </metadata>
Aug 08 23:24:34 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:24:34 user nova-compute[72405]:     <system>
Aug 08 23:24:34 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:24:34 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:24:34 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:24:34 user nova-compute[72405]:       <entry name="serial">c3d07e7d-a00e-4a8b-81e3-902cf007cde2</entry>
Aug 08 23:24:34 user nova-compute[72405]:       <entry name="uuid">c3d07e7d-a00e-4a8b-81e3-902cf007cde2</entry>
Aug 08 23:24:34 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:24:34 user nova-compute[72405]:     </system>
Aug 08 23:24:34 user nova-compute[72405]:   </sysinfo>
Aug 08 23:24:34 user nova-compute[72405]:   <os>
Aug 08 23:24:34 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:24:34 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:24:34 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:24:34 user nova-compute[72405]:   </os>
Aug 08 23:24:34 user nova-compute[72405]:   <features>
Aug 08 23:24:34 user nova-compute[72405]:     <acpi/>
Aug 08 23:24:34 user nova-compute[72405]:     <apic/>
Aug 08 23:24:34 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:24:34 user nova-compute[72405]:   </features>
Aug 08 23:24:34 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:24:34 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:24:34 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:24:34 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:24:34 user nova-compute[72405]:   </clock>
Aug 08 23:24:34 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:24:34 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:24:34 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:24:34 user nova-compute[72405]:   </cpu>
Aug 08 23:24:34 user nova-compute[72405]:   <devices>
Aug 08 23:24:34 user nova-compute[72405]:     <disk type="file" device="cdrom">
Aug 08 23:24:34 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none"/>
Aug 08 23:24:34 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2/disk.config"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="hda" bus="ide"/>
Aug 08 23:24:34 user nova-compute[72405]:     </disk>
Aug 08 23:24:34 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:24:34 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:24:34 user nova-compute[72405]:       <source dev="/dev/sdc"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <serial>a392004b-3893-4731-9eb1-a22dc1d73ad7</serial>
Aug 08 23:24:34 user nova-compute[72405]:     </disk>
Aug 08 23:24:34 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:24:34 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:24:34 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <serial>f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20</serial>
Aug 08 23:24:34 user nova-compute[72405]:     </disk>
Aug 08 23:24:34 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:24:34 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:24:34 user nova-compute[72405]:       <source dev="/dev/sde"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="vdc" bus="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <serial>1e9ace62-0227-4746-af80-87313f305f95</serial>
Aug 08 23:24:34 user nova-compute[72405]:     </disk>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:01:cb:57"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tap94100f59-ca"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:ae:40:83"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tap7782ca35-83"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:e5:01:e4"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tape0af855a-88"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:ff:3c:38"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tap9ffbae4e-e1"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:75:06:e7"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tap80db08a8-26"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:78:e2:f1"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tap6eb9b413-72"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:24:34 user nova-compute[72405]:       <mac address="fa:16:3e:4b:f0:ad"/>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:24:34 user nova-compute[72405]:       <target dev="tap8ded0468-3c"/>
Aug 08 23:24:34 user nova-compute[72405]:     </interface>
Aug 08 23:24:34 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:24:34 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2/console.log" append="off"/>
Aug 08 23:24:34 user nova-compute[72405]:     </serial>
Aug 08 23:24:34 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:24:34 user nova-compute[72405]:     <video>
Aug 08 23:24:34 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:24:34 user nova-compute[72405]:     </video>
Aug 08 23:24:34 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:24:34 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:24:34 user nova-compute[72405]:     </rng>
Aug 08 23:24:34 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:24:34 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:24:34 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:24:34 user nova-compute[72405]:     </memballoon>
Aug 08 23:24:34 user nova-compute[72405]:   </devices>
Aug 08 23:24:34 user nova-compute[72405]: </domain>
Aug 08 23:24:34 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94100f59-ca, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94100f59-ca, col_values=(('external_ids', {'iface-id': '94100f59-cac9-428d-8e61-74b20c90d6f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:cb:57', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7782ca35-83, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7782ca35-83, col_values=(('external_ids', {'iface-id': '7782ca35-8361-436f-a2e4-76f0a66bb15a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:40:83', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0af855a-88, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0af855a-88, col_values=(('external_ids', {'iface-id': 'e0af855a-8881-4ce7-99f5-40df76bd1c80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:01:e4', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ffbae4e-e1, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ffbae4e-e1, col_values=(('external_ids', {'iface-id': '9ffbae4e-e1a9-46eb-9e94-d7221788880f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:3c:38', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80db08a8-26, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80db08a8-26, col_values=(('external_ids', {'iface-id': '80db08a8-2674-4568-a637-0edc4d110763', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:06:e7', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb9b413-72, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6eb9b413-72, col_values=(('external_ids', {'iface-id': '6eb9b413-72dc-4187-8470-126b1106e523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:e2:f1', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ded0468-3c, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ded0468-3c, col_values=(('external_ids', {'iface-id': '8ded0468-3c34-48c4-b84b-af969b3ba3ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:f0:ad', 'vm-uuid': 'c3d07e7d-a00e-4a8b-81e3-902cf007cde2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:34 user nova-compute[72405]: INFO os_vif [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c')
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] No BDM found with device name hda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] No VIF found with MAC fa:16:3e:01:cb:57, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:24:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] No VIF found with MAC fa:16:3e:75:06:e7, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:24:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Using config drive
Aug 08 23:24:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Creating config drive at /opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2/disk.config
Aug 08 23:24:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk8hktbpi {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk8hktbpi" returned: 0 in 0.053s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Snapshot image upload complete
Aug 08 23:24:36 user nova-compute[72405]: INFO nova.compute.manager [None req-b8542be4-9b27-4926-907b-5bc8b83a0660 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Took 6.49 seconds to snapshot the instance on the hypervisor.
Aug 08 23:24:36 user nova-compute[72405]: DEBUG nova.compute.manager [req-1212ba7c-a83d-4e29-846e-a970151f43b1 req-03a93c0b-31c5-4e55-9b9c-6cd5e5ac9d41 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1212ba7c-a83d-4e29-846e-a970151f43b1 req-03a93c0b-31c5-4e55-9b9c-6cd5e5ac9d41 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1212ba7c-a83d-4e29-846e-a970151f43b1 req-03a93c0b-31c5-4e55-9b9c-6cd5e5ac9d41 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1212ba7c-a83d-4e29-846e-a970151f43b1 req-03a93c0b-31c5-4e55-9b9c-6cd5e5ac9d41 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:36 user nova-compute[72405]: DEBUG nova.compute.manager [req-1212ba7c-a83d-4e29-846e-a970151f43b1 req-03a93c0b-31c5-4e55-9b9c-6cd5e5ac9d41 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:36 user nova-compute[72405]: WARNING nova.compute.manager [req-1212ba7c-a83d-4e29-846e-a970151f43b1 req-03a93c0b-31c5-4e55-9b9c-6cd5e5ac9d41 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 for instance with vm_state building and task_state spawning.
Aug 08 23:24:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.167s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:37 user nova-compute[72405]: INFO nova.compute.manager [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Attaching volume fb83d67a-835b-403c-8a53-b4289f44490e to /dev/vdb
Aug 08 23:24:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-9ccad237-c774-4b09-9683-dd6d46eacb08 req-415aa355-a44f-4df8-b2c9-433580fb2ce3 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9ccad237-c774-4b09-9683-dd6d46eacb08 req-415aa355-a44f-4df8-b2c9-433580fb2ce3 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9ccad237-c774-4b09-9683-dd6d46eacb08 req-415aa355-a44f-4df8-b2c9-433580fb2ce3 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9ccad237-c774-4b09-9683-dd6d46eacb08 req-415aa355-a44f-4df8-b2c9-433580fb2ce3 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-9ccad237-c774-4b09-9683-dd6d46eacb08 req-415aa355-a44f-4df8-b2c9-433580fb2ce3 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:37 user nova-compute[72405]: WARNING nova.compute.manager [req-9ccad237-c774-4b09-9683-dd6d46eacb08 req-415aa355-a44f-4df8-b2c9-433580fb2ce3 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a for instance with vm_state building and task_state spawning.
Aug 08 23:24:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG os_brick.utils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[81684b1c-969a-4cf4-a8c4-9fb75fcd93d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f801885-1e27-4718-bce2-cc601ffb0b78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbecab-2f1a-4351-ba3e-819ed30e7345]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[824169a5-23ad-4245-bd96-6ddc4c84b911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:37 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[003fde92-be84-41e9-b9cb-8c07f4bf2922]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG os_brick.utils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:37 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating existing volume attachment record: ca493d58-8245-4740-a988-88691359f8a7 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f40fea6-bdbc-4b98-8cf7-e346dfaf40b1 req-2f291e48-4406-4001-a7dd-c93d8d164124 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f40fea6-bdbc-4b98-8cf7-e346dfaf40b1 req-2f291e48-4406-4001-a7dd-c93d8d164124 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f40fea6-bdbc-4b98-8cf7-e346dfaf40b1 req-2f291e48-4406-4001-a7dd-c93d8d164124 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f40fea6-bdbc-4b98-8cf7-e346dfaf40b1 req-2f291e48-4406-4001-a7dd-c93d8d164124 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f40fea6-bdbc-4b98-8cf7-e346dfaf40b1 req-2f291e48-4406-4001-a7dd-c93d8d164124 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:38 user nova-compute[72405]: WARNING nova.compute.manager [req-1f40fea6-bdbc-4b98-8cf7-e346dfaf40b1 req-2f291e48-4406-4001-a7dd-c93d8d164124 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f for instance with vm_state building and task_state spawning.
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:39 user nova-compute[72405]: WARNING nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 for instance with vm_state building and task_state spawning.
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:39 user nova-compute[72405]: WARNING nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 for instance with vm_state building and task_state spawning.
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:39 user nova-compute[72405]: WARNING nova.compute.manager [req-7c5d0d56-a7b5-4e36-af95-f605e3e9996e req-b07a5501-9e45-4866-9c33-4c1901dffa37 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 for instance with vm_state building and task_state spawning.
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-changed-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Refreshing instance network info cache due to event network-changed-95cda028-ebac-494b-a9cc-0e4b0511d395. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Acquiring lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Acquired lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Refreshing network info cache for port 95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updated VIF entry in instance network info cache for port 95cda028-ebac-494b-a9cc-0e4b0511d395. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updating instance_info_cache with network_info: [{"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Releasing lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:40 user nova-compute[72405]: WARNING nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a for instance with vm_state building and task_state spawning.
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:40 user nova-compute[72405]: WARNING nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 for instance with vm_state building and task_state spawning.
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:40 user nova-compute[72405]: WARNING nova.compute.manager [req-b714ee0d-152a-4314-b9a2-7cd168fed3d9 req-91796182-bc21-4add-bafd-ae9c5d6d7f0a service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 for instance with vm_state building and task_state spawning.
Aug 08 23:24:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing instance network info cache due to event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updated VIF entry in instance network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:41 user nova-compute[72405]: WARNING nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f for instance with vm_state building and task_state spawning.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:41 user nova-compute[72405]: WARNING nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 for instance with vm_state building and task_state spawning.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:41 user nova-compute[72405]: WARNING nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 for instance with vm_state building and task_state spawning.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:41 user nova-compute[72405]: WARNING nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca for instance with vm_state building and task_state spawning.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:41 user nova-compute[72405]: WARNING nova.compute.manager [req-f4cb5751-149d-4ec9-8538-70d82651942e req-709a3782-fe24-4510-b28b-ab51fe7dd6fe service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca for instance with vm_state building and task_state spawning.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537081.6140249, c3d07e7d-a00e-4a8b-81e3-902cf007cde2 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] VM Resumed (Lifecycle Event)
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance spawned successfully.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537081.619304, c3d07e7d-a00e-4a8b-81e3-902cf007cde2 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] VM Started (Lifecycle Event)
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Took 12.29 seconds to spawn the instance on the hypervisor.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:41 user nova-compute[72405]: INFO nova.compute.manager [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Took 41.06 seconds to build instance.
Aug 08 23:24:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8fbaf0d6-f19c-4cbd-8cce-dae9b52a3f53 tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.151s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:46 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:47 user nova-compute[72405]: INFO nova.compute.manager [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Attaching volume 3a9566b9-bcbc-4249-9be8-6e311e5e4348 to /dev/vdb
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.utils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6301fff3-d224-4cb0-98f3-f2f2456f3721]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b64954-38d3-4896-863f-01cf4fbbb86b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb2cbe-e29e-46e3-b4d6-508d6fe75925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc22eaa6-637b-4471-b8e7-d865aec65964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:47 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14800fcf-2d9b-4a3e-bb03-4f16467f2722]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.utils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updating existing volume attachment record: ff6b9fef-5c1b-4cac-9f04-0676bbaf50e9 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:47 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:47 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:47 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7e6b80-5c82-4ab3-b3f9-171bfe846e8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:24:47 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[044db4d4-f08d-4814-a06a-6b0c8f16b6b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e] added
Aug 08 23:24:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d35c0ba-7b4b-45bc-af53-6a6c9cbc03c6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfd3cd6-20a0-4064-a53d-cdb920c27c7c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqvxiMfE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqvxiMfE" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c598b5b-5697-4eac-8ab8-5c5e6436095c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqvxiMfE'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29cc54a-b8aa-4d9f-8d4f-b056d01dbd7d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5fd2e-b74a-4eb9-bb9f-fe87476fb4b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a4f2f-9cc4-44ec-ac4a-824e7e9f4611]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]
Aug 08 23:24:48 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976b1cd-133c-4f4a-af96-796335cf17d5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6afd36-3443-4c90-bef3-c27ffc2c5d15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:48 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fb55a0-478b-4e5b-976c-49608c082151]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEziKeaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:48 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26132613331663565', 'path': '/dev/sdf'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132613331663565', 'path': '/dev/sdf'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.540s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:49 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:49 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6851ef27-b78f-4064-8606-e6ae67884ee0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:24:49 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:24:49 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:24:49 user nova-compute[72405]:   <source dev="/dev/sdf"/>
Aug 08 23:24:49 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:24:49 user nova-compute[72405]:   <serial>fb83d67a-835b-403c-8a53-b4289f44490e</serial>
Aug 08 23:24:49 user nova-compute[72405]: </disk>
Aug 08 23:24:49 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d356864a-aad4-4a53-9d07-404799ae7a69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09] added
Aug 08 23:24:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[65348b9b-ad97-4c2e-bd35-31fbee619951]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f56f2-2fcd-4f50-b138-f46acdff4a66]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEziKeaB {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEziKeaB" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d85ef-d2d3-43d2-9408-fba3c711fd05]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEziKeaB'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde91759-e468-4256-89b8-f2080bd51174]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c5579-09ae-4c5a-9607-76b03fa17748]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[83137b43-c618-4c89-a7c1-7d6c8521af5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260]
Aug 08 23:24:49 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263746e-37ff-4fec-a528-c1b673aa443d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee6c691-fd5b-47f3-b55c-1a355a1497a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:49 user nova-compute[72405]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 (non-flash)
Aug 08 23:24:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd19b7-3b00-452d-9a17-1483f7bddf68]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No VIF found with MAC fa:16:3e:f6:53:af, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa55-b303-4cb5-a3ad-1b6b0713064e tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.058s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:50 user nova-compute[72405]: INFO nova.compute.manager [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Shelving
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72405) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEziKeaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] <== connect_volume: return (1892ms) {'type': 'block', 'scsi_wwn': '23835666662626230', 'path': '/dev/sdg'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835666662626230', 'path': '/dev/sdg'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lazy-loading 'flavor' on Instance uuid 1653b9e2-dbff-4620-90d2-b59e612fc3f4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:24:50 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:24:50 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:24:50 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:24:50 user nova-compute[72405]:   <serial>7521ff22-6d07-4dff-b9ff-dd6cb9a56a09</serial>
Aug 08 23:24:50 user nova-compute[72405]: </disk>
Aug 08 23:24:50 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-5e6e39c4-4596-4430-90c3-a9b01cd1242a req-9d7682b1-11c2-40e3-bded-6efb348e8081 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e6e39c4-4596-4430-90c3-a9b01cd1242a req-9d7682b1-11c2-40e3-bded-6efb348e8081 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e6e39c4-4596-4430-90c3-a9b01cd1242a req-9d7682b1-11c2-40e3-bded-6efb348e8081 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e6e39c4-4596-4430-90c3-a9b01cd1242a req-9d7682b1-11c2-40e3-bded-6efb348e8081 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-5e6e39c4-4596-4430-90c3-a9b01cd1242a req-9d7682b1-11c2-40e3-bded-6efb348e8081 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:50 user nova-compute[72405]: WARNING nova.compute.manager [req-5e6e39c4-4596-4430-90c3-a9b01cd1242a req-9d7682b1-11c2-40e3-bded-6efb348e8081 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state active and task_state powering-off.
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-d59436fd-21ef-40fe-98fe-0511c62ad7ab req-36544368-c336-4082-91aa-6bab613cbcd4 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d59436fd-21ef-40fe-98fe-0511c62ad7ab req-36544368-c336-4082-91aa-6bab613cbcd4 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d59436fd-21ef-40fe-98fe-0511c62ad7ab req-36544368-c336-4082-91aa-6bab613cbcd4 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d59436fd-21ef-40fe-98fe-0511c62ad7ab req-36544368-c336-4082-91aa-6bab613cbcd4 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-d59436fd-21ef-40fe-98fe-0511c62ad7ab req-36544368-c336-4082-91aa-6bab613cbcd4 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:50 user nova-compute[72405]: WARNING nova.compute.manager [req-d59436fd-21ef-40fe-98fe-0511c62ad7ab req-36544368-c336-4082-91aa-6bab613cbcd4 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state active and task_state shelving.
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance destroyed successfully.
Aug 08 23:24:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance destroyed successfully.
Aug 08 23:24:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Beginning cold snapshot process
Aug 08 23:24:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e39b236f-fa1b-40c1-b137-55edbe0d3884 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.145s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk /opt/stack/data/nova/instances/snapshots/tmpojjk57z8/e92fa5ae98924d0d92889b7a6eecf5c5 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] No VIF found with MAC fa:16:3e:d9:5f:12, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa16b15e-db30-4640-bc0b-f5230120d949 tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.820s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:52 user nova-compute[72405]: INFO nova.compute.manager [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Terminating instance
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk /opt/stack/data/nova/instances/snapshots/tmpojjk57z8/e92fa5ae98924d0d92889b7a6eecf5c5" returned: 0 in 0.991s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:52 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Snapshot extracted, beginning image upload
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:52 user nova-compute[72405]: WARNING nova.compute.manager [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state stopped and task_state None.
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-changed-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Refreshing instance network info cache due to event network-changed-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] Acquiring lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] Acquired lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.network.neutron [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Refreshing network info cache for port 886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-6c7d9ff3-ffee-4990-86cb-639793f1dd0b req-98ef3520-970e-465e-b794-c848b8576aca service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6c7d9ff3-ffee-4990-86cb-639793f1dd0b req-98ef3520-970e-465e-b794-c848b8576aca service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6c7d9ff3-ffee-4990-86cb-639793f1dd0b req-98ef3520-970e-465e-b794-c848b8576aca service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6c7d9ff3-ffee-4990-86cb-639793f1dd0b req-98ef3520-970e-465e-b794-c848b8576aca service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-6c7d9ff3-ffee-4990-86cb-639793f1dd0b req-98ef3520-970e-465e-b794-c848b8576aca service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:52 user nova-compute[72405]: WARNING nova.compute.manager [req-6c7d9ff3-ffee-4990-86cb-639793f1dd0b req-98ef3520-970e-465e-b794-c848b8576aca service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state active and task_state shelving_image_uploading.
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-f2e447c1-e014-4f34-92f0-81bce478622b req-59057816-c4c8-4f31-910c-aa53847db272 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-vif-unplugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f2e447c1-e014-4f34-92f0-81bce478622b req-59057816-c4c8-4f31-910c-aa53847db272 service nova] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f2e447c1-e014-4f34-92f0-81bce478622b req-59057816-c4c8-4f31-910c-aa53847db272 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f2e447c1-e014-4f34-92f0-81bce478622b req-59057816-c4c8-4f31-910c-aa53847db272 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-f2e447c1-e014-4f34-92f0-81bce478622b req-59057816-c4c8-4f31-910c-aa53847db272 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] No waiting events found dispatching network-vif-unplugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-f2e447c1-e014-4f34-92f0-81bce478622b req-59057816-c4c8-4f31-910c-aa53847db272 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-vif-unplugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:24:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Instance destroyed successfully.
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lazy-loading 'resources' on Instance uuid 1653b9e2-dbff-4620-90d2-b59e612fc3f4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-883556648',display_name='tempest-DeleteServersTestJSON-server-883556648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-883556648',id=1,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3900313ee6442da973f370f77cf6f14',ramdisk_id='',reservation_id='r-kg2jnej9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1797086066',owner_user_name='tempest-DeleteServersTestJSON-1797086066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:22:48Z,user_data=None,user_id='9ef4cd8a6a5143e2a8b1463d6fca7efa',uuid=1653b9e2-dbff-4620-90d2-b59e612fc3f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Converting VIF {"id": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "address": "fa:16:3e:d9:5f:12", "network": {"id": "67a9bef4-e253-41f0-8a85-80aead21d924", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1349575493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3900313ee6442da973f370f77cf6f14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6e3a7e-ef", "ovs_interfaceid": "ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_vif [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab6e3a7e-ef, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:53 user nova-compute[72405]: INFO os_vif [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5,network=Network(67a9bef4-e253-41f0-8a85-80aead21d924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6e3a7e-ef')
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEziKeaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:53 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70adc5-eb59-4693-800c-00bbea8f31b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[34722cb9-53e8-4d2a-87c2-cec173c4a0c1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:53 user nova-compute[72405]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 (non-flash)
Aug 08 23:24:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb785a3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09'): ({'sdg'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Removing single pathed devices sdg {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac0a043-58cb-4860-93eb-e651e2d87648]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d5c45-011b-4cfc-b0e6-6fbf765ce7b2]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Flushing IO for device /dev/sdg {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d722e-3eb5-478a-8302-099090219268]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda568a-8f22-4571-bb7b-d50796082213]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f254f2-2941-4d79-b79b-f0dad0222173]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b19c2-dfdd-4b07-b266-eba8d73263cc]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260]
Aug 08 23:24:53 user nova-compute[72405]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7521ff22-6d07-4dff-b9ff-dd6cb9a56a09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd9886-466e-4c81-a9dc-89618f6c95be]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] <== disconnect_volume: return (339ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:24:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Deleting instance files /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4_del
Aug 08 23:24:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Deletion of /opt/stack/data/nova/instances/1653b9e2-dbff-4620-90d2-b59e612fc3f4_del complete
Aug 08 23:24:53 user nova-compute[72405]: INFO nova.compute.manager [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 08 23:24:53 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:24:53 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:54 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Took 0.61 seconds to deallocate network for instance.
Aug 08 23:24:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Updated VIF entry in instance network info cache for port 886e7e28-cba5-4fdd-956e-b2b1a1ca7d06. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Updating instance_info_cache with network_info: [{"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-09845e9b-bc97-47c0-8106-7ac6b45835e9 req-47100ba6-e9e7-46c8-b417-1eb28d61a779 service nova] Releasing lock "refresh_cache-139270d7-7024-4397-a005-618e17165718" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-48f2c0c6-d08d-4734-bbbc-2be2e7cf9561 req-1d362d87-0f5a-4f9c-a14d-c27d78fc0964 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-vif-deleted-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-3a4fcf36-ebb5-4606-a9b1-7d0db788ab55 req-2e808ada-d1c3-4e6b-8b76-454de0003d16 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received event network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3a4fcf36-ebb5-4606-a9b1-7d0db788ab55 req-2e808ada-d1c3-4e6b-8b76-454de0003d16 service nova] Acquiring lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3a4fcf36-ebb5-4606-a9b1-7d0db788ab55 req-2e808ada-d1c3-4e6b-8b76-454de0003d16 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3a4fcf36-ebb5-4606-a9b1-7d0db788ab55 req-2e808ada-d1c3-4e6b-8b76-454de0003d16 service nova] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-3a4fcf36-ebb5-4606-a9b1-7d0db788ab55 req-2e808ada-d1c3-4e6b-8b76-454de0003d16 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] No waiting events found dispatching network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:24:54 user nova-compute[72405]: WARNING nova.compute.manager [req-3a4fcf36-ebb5-4606-a9b1-7d0db788ab55 req-2e808ada-d1c3-4e6b-8b76-454de0003d16 service nova] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Received unexpected event network-vif-plugged-ab6e3a7e-ef05-4f1e-816a-b72c05c2d8b5 for instance with vm_state active and task_state deleting.
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-changed-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Refreshing instance network info cache due to event network-changed-d3dc4ecd-2751-40aa-9424-b64b17934399. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] Acquiring lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] Acquired lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.network.neutron [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Refreshing network info cache for port d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:55 user nova-compute[72405]: INFO nova.compute.manager [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Took 0.84 seconds to detach 1 volumes for instance.
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Snapshot image upload complete
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:55 user nova-compute[72405]: INFO nova.compute.manager [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Shelve offloading
Aug 08 23:24:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance destroyed successfully.
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.network.neutron [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updated VIF entry in instance network info cache for port d3dc4ecd-2751-40aa-9424-b64b17934399. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.network.neutron [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updating instance_info_cache with network_info: [{"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a49dc753-edc9-48cd-bc63-7f8d3aadb7d6 req-4aa1c175-bee7-49d3-9b07-e0a349336b79 service nova] Releasing lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:24:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:55 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Deleted allocations for instance 1653b9e2-dbff-4620-90d2-b59e612fc3f4
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9a2f-e333-4ffd-b1e6-4c0355369f3c tempest-DeleteServersTestJSON-1797086066 tempest-DeleteServersTestJSON-1797086066-project-member] Lock "1653b9e2-dbff-4620-90d2-b59e612fc3f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.480s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "139270d7-7024-4397-a005-618e17165718" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lazy-loading 'flavor' on Instance uuid 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "139270d7-7024-4397-a005-618e17165718" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:56 user nova-compute[72405]: INFO nova.compute.manager [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Attaching volume 33edcb30-5bb4-437e-bbd3-3c980bafcc1e to /dev/sdc
Aug 08 23:24:56 user nova-compute[72405]: DEBUG os_brick.utils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ff550-23d0-417c-9dd4-67790248e682]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9536b-736f-4fdb-9f3f-4bfe577898e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf07a9c-6bb2-476f-abab-858fa775d63b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c23ba-5ce5-4a7d-a8fd-85d82546f2d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:24:56 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:24:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46eef86-2ec6-4762-8135-6f25f821fe49]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG os_brick.utils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:56 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Updating existing volume attachment record: 4e8e925d-77db-4be1-a627-479b24584ccd {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVEhemKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:24:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:24:57 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e265b456-1512-44a5-9542-a40d7c4cbcfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:24:57 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae6fbca-5cd1-41aa-bc40-55adebc47f1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348] added
Aug 08 23:24:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[165cec2e-9660-46e6-925c-d70bb71357ba]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca2873-4e8e-43d0-bbef-075da9866058]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVEhemKW {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVEhemKW" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d5b91-8ff4-44cb-b8d3-042a31aec2bd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aVEhemKW'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bcc6a4-949f-4755-b550-c4e5ca5c2c42]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e66fa5-5e8c-40d8-9879-e17c4f453352]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[99da991c-9ff8-40ad-94ab-f2d677a0fe16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260]
Aug 08 23:24:57 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260] successful.
Aug 08 23:24:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance destroyed successfully.
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'resources' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad16ec4a-47da-42c2-9c4c-9147b95fbfc5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1634977089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1634977089',id=5,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBT4Lyh9dl7ZNEvz9gDo3XYV4USF1K1eFewyehMSS7XV3yHhOoLkyg3N7NLRn9b+Wg3ImzdxmsasFpRmWm/DC/IQZPdxfY42D81mzjUYsH6M+17eIcBNI+h4OYTjCNGmQ==',key_name='tempest-keypair-380907040',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-ozqx2sck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member',shelved_at='2023-08-08T23:24:55.564365',shelved_host='user',shelved_image_id='cf1a14f9-b145-4093-b880-ab78abe03a6a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=16d8b7a1-0c6b-444f-b17c-c64caa2ece8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_vif [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing instance network info cache due to event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a42571c-14, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e3a244-3fba-4398-84e2-cef871020703]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:24:57 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:24:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:24:57 user nova-compute[72405]: INFO os_vif [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14')
Aug 08 23:24:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Deleting instance files /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c_del
Aug 08 23:24:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Deletion of /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c_del complete
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e1bc2-a426-4457-b69d-a5691b56fd08]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVEhemKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:24:57 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Deleted allocations for instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:24:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'numa_topology' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updated VIF entry in instance network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9a42571c-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0bc1dde5-998a-43d6-89e3-7c47d6197ade req-71c8311c-a667-4f73-8aeb-280452e7f700 service nova] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c0e37b68-cc41-49e3-8722-1378d18f21d7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.098s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23233386631386564', 'path': '/dev/sdg'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233386631386564', 'path': '/dev/sdg'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:24:58 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:24:58 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:24:58 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:24:58 user nova-compute[72405]:   <serial>3a9566b9-bcbc-4249-9be8-6e311e5e4348</serial>
Aug 08 23:24:58 user nova-compute[72405]: </disk>
Aug 08 23:24:58 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:24:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:3e:2c:15, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:24:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e8cbdcf1-df56-4838-b9e9-e7932ca4bc6b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.106s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG nova.objects.instance [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'flavor' on Instance uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:00 user nova-compute[72405]: INFO nova.compute.manager [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Attaching volume 6b8d53dd-4fd6-4350-8fac-5e741936053a to /dev/vdb
Aug 08 23:25:00 user nova-compute[72405]: DEBUG os_brick.utils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3d14b-7a75-48e6-9945-8fe3d3c5d4d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25272d-3ee4-4c93-b024-cc823f9c003e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0de82b-1c67-450f-8f65-4573b8affef1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c894ba-da07-4eae-a2b9-f724fbfe847d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:00 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1403574-ceb1-49a2-82cd-08ded6263125]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG os_brick.utils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:00 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updating existing volume attachment record: a17364e8-df54-4c6a-9b35-ce5690145e13 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:02 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:25:02 user nova-compute[72405]: INFO nova.compute.claims [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Claim successful on node user
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:25:03 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.policy [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8334edbf14ec382f6cd1c426703c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a146c9a0c224249ac3316e931874bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:25:03 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Creating image(s)
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "/opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.182s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk 1073741824" returned: 0 in 0.051s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Successfully created port: 76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Cannot resize image /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:25:03 user nova-compute[72405]: DEBUG nova.objects.instance [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'migration_context' on Instance uuid 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Ensure instance console log exists: /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Successfully updated port: 76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquired lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-changed-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Refreshing instance network info cache due to event network-changed-76de9722-88a4-4bc1-a074-5edbb5b51e62. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] Acquiring lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updating instance_info_cache with network_info: [{"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Releasing lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Instance network_info: |[{"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] Acquired lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Refreshing network info cache for port 76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Start _get_guest_xml network_info=[{"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:25:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:25:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-498162237',display_name='tempest-AttachVolumeNegativeTest-server-498162237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-498162237',id=13,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZLdZFed1kSjFv5vVkjqgd0oHf7Rzo+h6PKZd7D1Sd75pGh+tZTW7ZDHDKUx4O6TPfM+98aP8IPDwWWFDAhnvb5nXTpIqsuKN+9uNTE0XrDf7bv0DDx6HMVxNCWe8E5rQ==',key_name='tempest-keypair-1529781642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-m1u4cmcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=4efaaaf8-fcb6-408b-9374-e6dcdd2adaec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'pci_devices' on Instance uuid 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:25:05 user nova-compute[72405]:   <uuid>4efaaaf8-fcb6-408b-9374-e6dcdd2adaec</uuid>
Aug 08 23:25:05 user nova-compute[72405]:   <name>instance-0000000d</name>
Aug 08 23:25:05 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:25:05 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:25:05 user nova-compute[72405]:   <metadata>
Aug 08 23:25:05 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:25:05 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:25:05 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeNegativeTest-server-498162237</nova:name>
Aug 08 23:25:05 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:25:05</nova:creationTime>
Aug 08 23:25:05 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:25:05 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:25:05 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:25:05 user nova-compute[72405]:       <nova:owner>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:user uuid="5eb8334edbf14ec382f6cd1c426703c6">tempest-AttachVolumeNegativeTest-1663634564-project-member</nova:user>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:project uuid="4a146c9a0c224249ac3316e931874bc5">tempest-AttachVolumeNegativeTest-1663634564</nova:project>
Aug 08 23:25:05 user nova-compute[72405]:       </nova:owner>
Aug 08 23:25:05 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:25:05 user nova-compute[72405]:       <nova:ports>
Aug 08 23:25:05 user nova-compute[72405]:         <nova:port uuid="76de9722-88a4-4bc1-a074-5edbb5b51e62">
Aug 08 23:25:05 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:25:05 user nova-compute[72405]:         </nova:port>
Aug 08 23:25:05 user nova-compute[72405]:       </nova:ports>
Aug 08 23:25:05 user nova-compute[72405]:     </nova:instance>
Aug 08 23:25:05 user nova-compute[72405]:   </metadata>
Aug 08 23:25:05 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:25:05 user nova-compute[72405]:     <system>
Aug 08 23:25:05 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:25:05 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:25:05 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:25:05 user nova-compute[72405]:       <entry name="serial">4efaaaf8-fcb6-408b-9374-e6dcdd2adaec</entry>
Aug 08 23:25:05 user nova-compute[72405]:       <entry name="uuid">4efaaaf8-fcb6-408b-9374-e6dcdd2adaec</entry>
Aug 08 23:25:05 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:25:05 user nova-compute[72405]:     </system>
Aug 08 23:25:05 user nova-compute[72405]:   </sysinfo>
Aug 08 23:25:05 user nova-compute[72405]:   <os>
Aug 08 23:25:05 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:25:05 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:25:05 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:25:05 user nova-compute[72405]:   </os>
Aug 08 23:25:05 user nova-compute[72405]:   <features>
Aug 08 23:25:05 user nova-compute[72405]:     <acpi/>
Aug 08 23:25:05 user nova-compute[72405]:     <apic/>
Aug 08 23:25:05 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:25:05 user nova-compute[72405]:   </features>
Aug 08 23:25:05 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:25:05 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:25:05 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:25:05 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:25:05 user nova-compute[72405]:   </clock>
Aug 08 23:25:05 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:25:05 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:25:05 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:25:05 user nova-compute[72405]:   </cpu>
Aug 08 23:25:05 user nova-compute[72405]:   <devices>
Aug 08 23:25:05 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:25:05 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:25:05 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk"/>
Aug 08 23:25:05 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:25:05 user nova-compute[72405]:     </disk>
Aug 08 23:25:05 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:25:05 user nova-compute[72405]:       <mac address="fa:16:3e:d9:82:9f"/>
Aug 08 23:25:05 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:25:05 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:25:05 user nova-compute[72405]:       <target dev="tap76de9722-88"/>
Aug 08 23:25:05 user nova-compute[72405]:     </interface>
Aug 08 23:25:05 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:25:05 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/console.log" append="off"/>
Aug 08 23:25:05 user nova-compute[72405]:     </serial>
Aug 08 23:25:05 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:25:05 user nova-compute[72405]:     <video>
Aug 08 23:25:05 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:25:05 user nova-compute[72405]:     </video>
Aug 08 23:25:05 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:25:05 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:25:05 user nova-compute[72405]:     </rng>
Aug 08 23:25:05 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:25:05 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:25:05 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:25:05 user nova-compute[72405]:     </memballoon>
Aug 08 23:25:05 user nova-compute[72405]:   </devices>
Aug 08 23:25:05 user nova-compute[72405]: </domain>
Aug 08 23:25:05 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-498162237',display_name='tempest-AttachVolumeNegativeTest-server-498162237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-498162237',id=13,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZLdZFed1kSjFv5vVkjqgd0oHf7Rzo+h6PKZd7D1Sd75pGh+tZTW7ZDHDKUx4O6TPfM+98aP8IPDwWWFDAhnvb5nXTpIqsuKN+9uNTE0XrDf7bv0DDx6HMVxNCWe8E5rQ==',key_name='tempest-keypair-1529781642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-m1u4cmcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=4efaaaf8-fcb6-408b-9374-e6dcdd2adaec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG os_vif [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76de9722-88, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76de9722-88, col_values=(('external_ids', {'iface-id': '76de9722-88a4-4bc1-a074-5edbb5b51e62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:82:9f', 'vm-uuid': '4efaaaf8-fcb6-408b-9374-e6dcdd2adaec'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:05 user nova-compute[72405]: INFO os_vif [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88')
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:d9:82:9f, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updated VIF entry in instance network info cache for port 76de9722-88a4-4bc1-a074-5edbb5b51e62. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updating instance_info_cache with network_info: [{"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-91e50bbb-20e6-4c90-aa52-295c27221f11 req-224853eb-e8cb-4edd-8e85-c489d55d503b service nova] Releasing lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537091.222289, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:06 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Stopped (Lifecycle Event)
Aug 08 23:25:06 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537091.2362936, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:06 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] VM Stopped (Lifecycle Event)
Aug 08 23:25:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-462ee362-3353-4274-9663-99f4f38439dd None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fc0dab07-b992-45ee-9531-0c4f17f70586 None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-462ee362-3353-4274-9663-99f4f38439dd None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGryVSAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:06 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:06 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:06 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9df9714-2c41-451f-9018-61abf15d9330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:06 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1bf8fe-d3e8-4930-9fac-99248116fc0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e] added
Aug 08 23:25:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe452c7-01e3-4a7f-8813-c06a838e5f12]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad48d3-70cc-4121-8e58-5c448bad65f4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGryVSAb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGryVSAb" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd4838-4a41-45b1-a78a-d9a722455810]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGryVSAb'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4047ff96-1f13-46b0-a51d-b5e762d86244]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e5a196-cfbc-48b0-baa1-dfe81c1cd6c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1c8aa-af81-43c3-a58f-cc408a982b17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260]
Aug 08 23:25:06 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f7a414-ba9d-4d9b-a3f1-b2a3babbef94]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ab8ce8-3bd2-4390-8c44-f1869ad38e59]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:06 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35346a9-b800-40a8-bb50-f89c5025fe3c]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGryVSAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-960e178b-caea-4052-bdf8-98d7bd1e1ea6 req-b9a2ed00-eb25-491e-9507-4b393037db0a service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-960e178b-caea-4052-bdf8-98d7bd1e1ea6 req-b9a2ed00-eb25-491e-9507-4b393037db0a service nova] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-960e178b-caea-4052-bdf8-98d7bd1e1ea6 req-b9a2ed00-eb25-491e-9507-4b393037db0a service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-960e178b-caea-4052-bdf8-98d7bd1e1ea6 req-b9a2ed00-eb25-491e-9507-4b393037db0a service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-960e178b-caea-4052-bdf8-98d7bd1e1ea6 req-b9a2ed00-eb25-491e-9507-4b393037db0a service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] No waiting events found dispatching network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:07 user nova-compute[72405]: WARNING nova.compute.manager [req-960e178b-caea-4052-bdf8-98d7bd1e1ea6 req-b9a2ed00-eb25-491e-9507-4b393037db0a service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received unexpected event network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 for instance with vm_state building and task_state spawning.
Aug 08 23:25:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23865353233366363', 'path': '/dev/sdh'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865353233366363', 'path': '/dev/sdh'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lazy-loading 'flavor' on Instance uuid 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:25:07 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:07 user nova-compute[72405]:   <source dev="/dev/sdh"/>
Aug 08 23:25:07 user nova-compute[72405]:   <target dev="sdc" bus="scsi"/>
Aug 08 23:25:07 user nova-compute[72405]:   <serial>33edcb30-5bb4-437e-bbd3-3c980bafcc1e</serial>
Aug 08 23:25:07 user nova-compute[72405]:   <address type="drive" controller="0" unit="2"/>
Aug 08 23:25:07 user nova-compute[72405]: </disk>
Aug 08 23:25:07 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-changed-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Refreshing instance network info cache due to event network-changed-67827618-228c-474c-adaf-4692e1251fc1. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] Acquiring lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] Acquired lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Refreshing network info cache for port 67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No BDM found with device name sda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] No VIF found with MAC fa:16:3e:2f:1b:85, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537093.4209952, 1653b9e2-dbff-4620-90d2-b59e612fc3f4 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:08 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] VM Stopped (Lifecycle Event)
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-52b3e5e7-a25a-44fc-ac64-63d8bcd60a62 None None] [instance: 1653b9e2-dbff-4620-90d2-b59e612fc3f4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4d26a21a-9043-45ec-8c2a-86456b49fa83 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.772s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "interface-29c4e0e6-85dc-4db6-a801-2ff6a19115db-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "interface-29c4e0e6-85dc-4db6-a801-2ff6a19115db-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'flavor' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updated VIF entry in instance network info cache for port 67827618-228c-474c-adaf-4692e1251fc1. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9e8e2174-057f-4538-a9ad-44b2207fe946 req-62917d21-5de2-4399-a3d8-c12ca4ee8450 service nova] Releasing lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'pci_requests' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537108.9468536, 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:08 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] VM Resumed (Lifecycle Event)
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:25:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Instance spawned successfully.
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:25:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:25:08 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537108.948889, 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:09 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] VM Started (Lifecycle Event)
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.policy [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1da7c19e65443d49ebd11d20955166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4229ea3198b846819520ed06edf0eecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:25:09 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:25:09 user nova-compute[72405]: INFO nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-23788a9b-2d5b-45e1-b09b-7658bf6e4f8a req-61d30242-2271-4326-9da4-15e11021864e service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-23788a9b-2d5b-45e1-b09b-7658bf6e4f8a req-61d30242-2271-4326-9da4-15e11021864e service nova] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-23788a9b-2d5b-45e1-b09b-7658bf6e4f8a req-61d30242-2271-4326-9da4-15e11021864e service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-23788a9b-2d5b-45e1-b09b-7658bf6e4f8a req-61d30242-2271-4326-9da4-15e11021864e service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-23788a9b-2d5b-45e1-b09b-7658bf6e4f8a req-61d30242-2271-4326-9da4-15e11021864e service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] No waiting events found dispatching network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:09 user nova-compute[72405]: WARNING nova.compute.manager [req-23788a9b-2d5b-45e1-b09b-7658bf6e4f8a req-61d30242-2271-4326-9da4-15e11021864e service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received unexpected event network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 for instance with vm_state building and task_state spawning.
Aug 08 23:25:09 user nova-compute[72405]: INFO nova.compute.manager [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Took 6.57 seconds to build instance.
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-adc64525-d895-41bb-b380-e893e4614940 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Successfully created port: 5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQBlrAdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:09 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:09 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:09 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ed893-b0b2-407d-9461-e8f3d3d6d03e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:09 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d620d9e0-b0d5-43fe-b017-e9e7a7bdbc6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a] added
Aug 08 23:25:09 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb3dd5-b1f9-490c-98ec-d850834ea4d3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[99debbd7-33ed-44f6-b98e-697178d002c8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQBlrAdk {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQBlrAdk" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ac280-24fa-4f23-86d4-0f560d293dcb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQBlrAdk'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[280016d3-6e07-4f27-8ea5-c1405ac50222]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "139270d7-7024-4397-a005-618e17165718" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da026b-6729-4c66-ac6d-fe7c810156fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:10 user nova-compute[72405]: INFO nova.compute.manager [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Detaching volume 33edcb30-5bb4-437e-bbd3-3c980bafcc1e
Aug 08 23:25:10 user nova-compute[72405]: INFO nova.virt.block_device [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Attempting to driver detach volume 33edcb30-5bb4-437e-bbd3-3c980bafcc1e from mountpoint /dev/sdc
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[04592a8e-82c3-44d7-b9d2-4f31c8bd5fae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260]
Aug 08 23:25:10 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Attempting to detach device sdc from instance 139270d7-7024-4397-a005-618e17165718 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:10 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:10 user nova-compute[72405]:   <source dev="/dev/sdh"/>
Aug 08 23:25:10 user nova-compute[72405]:   <target dev="sdc" bus="scsi"/>
Aug 08 23:25:10 user nova-compute[72405]:   <serial>33edcb30-5bb4-437e-bbd3-3c980bafcc1e</serial>
Aug 08 23:25:10 user nova-compute[72405]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 08 23:25:10 user nova-compute[72405]: </disk>
Aug 08 23:25:10 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Successfully detached device sdc from instance 139270d7-7024-4397-a005-618e17165718 from the persistent domain config.
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 139270d7-7024-4397-a005-618e17165718 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:10 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:10 user nova-compute[72405]:   <source dev="/dev/sdh"/>
Aug 08 23:25:10 user nova-compute[72405]:   <target dev="sdc" bus="scsi"/>
Aug 08 23:25:10 user nova-compute[72405]:   <serial>33edcb30-5bb4-437e-bbd3-3c980bafcc1e</serial>
Aug 08 23:25:10 user nova-compute[72405]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 08 23:25:10 user nova-compute[72405]: </disk>
Aug 08 23:25:10 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cac7bf-4d95-4428-9cf0-c0d659871e7e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b462dc-a14c-46e4-b12b-1895097a361a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:10 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c3bc3-d539-4098-8593-e1b0280d8c90]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537110.669384, 139270d7-7024-4397-a005-618e17165718 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:25:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Successfully detached device sdc from instance 139270d7-7024-4397-a005-618e17165718 from the live domain config.
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGryVSAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:10 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Successfully updated port: 5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquired lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQBlrAdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23264306332333034', 'path': '/dev/sdi'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264306332333034', 'path': '/dev/sdi'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.587s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'flavor' on Instance uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[67961768-de77-48f8-8fa5-49b130db6f59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:25:11 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:11 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:25:11 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:11 user nova-compute[72405]:   <serial>6b8d53dd-4fd6-4350-8fac-5e741936053a</serial>
Aug 08 23:25:11 user nova-compute[72405]: </disk>
Aug 08 23:25:11 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61f8d3-785d-4718-937b-1cfc55ffe602]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:11 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:11 user nova-compute[72405]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e (non-flash)
Aug 08 23:25:11 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb786a5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e'): ({'sdh'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Removing single pathed devices sdh {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8313427b-1c4f-47da-bfc8-79d491e02e2c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[573b92ae-e45f-44d8-a4e0-2783b7db1d40]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Flushing IO for device /dev/sdh {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1a4ea6-920f-4783-9033-1cc689297713]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.059s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abbea9d-26be-449b-a36d-3429487a3209]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] SCSI volumes sdh have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-changed-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Refreshing instance network info cache due to event network-changed-5db510f5-38c3-4a81-934b-e1ab20e1db31. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] Acquiring lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b90d5-1fd8-48ec-8884-e76ef4c8c089]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3998c2-9ccd-49fd-9cd4-01fccc4caee5]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260]
Aug 08 23:25:11 user nova-compute[72405]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:11 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33edcb30-5bb4-437e-bbd3-3c980bafcc1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff525a-53e4-44f2-9585-4bd37de1cf82]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] <== disconnect_volume: return (936ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No VIF found with MAC fa:16:3e:e6:0f:98, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-af443c7e-21b9-4fd6-8fcf-16d7126493f8 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.653s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Releasing lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] Acquired lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Refreshing network info cache for port 5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG os_vif [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db510f5-38, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5db510f5-38, col_values=(('external_ids', {'iface-id': '5db510f5-38c3-4a81-934b-e1ab20e1db31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:a8:43', 'vm-uuid': '29c4e0e6-85dc-4db6-a801-2ff6a19115db'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: INFO os_vif [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38')
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] attach device xml: <interface type="ethernet">
Aug 08 23:25:12 user nova-compute[72405]:   <mac address="fa:16:3e:05:a8:43"/>
Aug 08 23:25:12 user nova-compute[72405]:   <model type="virtio"/>
Aug 08 23:25:12 user nova-compute[72405]:   <mtu size="1442"/>
Aug 08 23:25:12 user nova-compute[72405]:   <target dev="tap5db510f5-38"/>
Aug 08 23:25:12 user nova-compute[72405]: </interface>
Aug 08 23:25:12 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lazy-loading 'flavor' on Instance uuid 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-052e62e0-41bd-4206-bec5-16350a479447 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.493s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lazy-loading 'flavor' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updated VIF entry in instance network info cache for port 5db510f5-38c3-4a81-934b-e1ab20e1db31. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-73cb5184-315f-4a13-aa94-f264951d5c7f req-76916b68-6a5e-444c-a984-9fc9cd4214bf service nova] Releasing lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-87b19eca-425f-4be6-8d46-2da9b74bdcd4 req-376e220c-0cf3-44ae-9578-302589944321 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87b19eca-425f-4be6-8d46-2da9b74bdcd4 req-376e220c-0cf3-44ae-9578-302589944321 service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87b19eca-425f-4be6-8d46-2da9b74bdcd4 req-376e220c-0cf3-44ae-9578-302589944321 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87b19eca-425f-4be6-8d46-2da9b74bdcd4 req-376e220c-0cf3-44ae-9578-302589944321 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-87b19eca-425f-4be6-8d46-2da9b74bdcd4 req-376e220c-0cf3-44ae-9578-302589944321 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:12 user nova-compute[72405]: WARNING nova.compute.manager [req-87b19eca-425f-4be6-8d46-2da9b74bdcd4 req-376e220c-0cf3-44ae-9578-302589944321 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 for instance with vm_state active and task_state None.
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No BDM found with device name hda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No VIF found with MAC fa:16:3e:b0:85:4a, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:25:12 user nova-compute[72405]:   <nova:package version="0.0.0"/>
Aug 08 23:25:12 user nova-compute[72405]:   <nova:name>tempest-device-tagging-server-714913135</nova:name>
Aug 08 23:25:12 user nova-compute[72405]:   <nova:creationTime>2023-08-08 23:25:12</nova:creationTime>
Aug 08 23:25:12 user nova-compute[72405]:   <nova:flavor name="m1.tiny">
Aug 08 23:25:12 user nova-compute[72405]:     <nova:memory>512</nova:memory>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:disk>1</nova:disk>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:swap>0</nova:swap>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:vcpus>1</nova:vcpus>
Aug 08 23:25:12 user nova-compute[72405]:   </nova:flavor>
Aug 08 23:25:12 user nova-compute[72405]:   <nova:owner>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:user uuid="d1da7c19e65443d49ebd11d20955166f">tempest-TaggedAttachmentsTest-628633788-project-member</nova:user>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:project uuid="4229ea3198b846819520ed06edf0eecd">tempest-TaggedAttachmentsTest-628633788</nova:project>
Aug 08 23:25:12 user nova-compute[72405]:   </nova:owner>
Aug 08 23:25:12 user nova-compute[72405]:   <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:25:12 user nova-compute[72405]:   <nova:ports>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:port uuid="67827618-228c-474c-adaf-4692e1251fc1">
Aug 08 23:25:12 user nova-compute[72405]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:25:12 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:12 user nova-compute[72405]:     <nova:port uuid="5db510f5-38c3-4a81-934b-e1ab20e1db31">
Aug 08 23:25:12 user nova-compute[72405]:       <nova:ip type="fixed" address="10.10.10.200" ipVersion="4"/>
Aug 08 23:25:12 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:12 user nova-compute[72405]:   </nova:ports>
Aug 08 23:25:12 user nova-compute[72405]: </nova:instance>
Aug 08 23:25:12 user nova-compute[72405]:  {{(pid=72405) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-12c61d83-0f91-4bb6-a560-5bff96ffe77a tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "interface-29c4e0e6-85dc-4db6-a801-2ff6a19115db-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.031s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:12 user nova-compute[72405]: INFO nova.compute.manager [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Attaching volume 5e0bc637-777f-4982-b80b-4d8fdaa4ed07 to /dev/vdb
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:12 user nova-compute[72405]: DEBUG os_brick.utils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2a1b5-94e3-4616-a5d1-f89fbb4ac23c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:13 user nova-compute[72405]: INFO nova.compute.manager [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Detaching volume 6b8d53dd-4fd6-4350-8fac-5e741936053a
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38df5e9-b8ee-434a-a08e-d965e4465f2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd29e2-980b-43ae-b8a8-a52ffe1a2010]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24045193-86a3-49b9-83df-71610bf3223d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:13 user nova-compute[72405]: INFO nova.virt.block_device [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Attempting to driver detach volume 6b8d53dd-4fd6-4350-8fac-5e741936053a from mountpoint /dev/vdb
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Attempting to detach device vdb from instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:13 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:13 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:25:13 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:13 user nova-compute[72405]:   <serial>6b8d53dd-4fd6-4350-8fac-5e741936053a</serial>
Aug 08 23:25:13 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:25:13 user nova-compute[72405]: </disk>
Aug 08 23:25:13 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:13 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce91f6-96e9-4e4a-ba27-da5f8364cdd3]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.utils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updating existing volume attachment record: a8578a89-da33-4ccd-b1af-6c6631339bba {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:25:13 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Successfully detached device vdb from instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 from the persistent domain config.
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:13 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:13 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:25:13 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:13 user nova-compute[72405]:   <serial>6b8d53dd-4fd6-4350-8fac-5e741936053a</serial>
Aug 08 23:25:13 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:25:13 user nova-compute[72405]: </disk>
Aug 08 23:25:13 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'flavor' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:13 user nova-compute[72405]: INFO nova.compute.manager [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Attaching volume b0e71e35-f430-4448-ada5-64550dffd767 to /dev/vdb
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.utils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c41e9d-b27c-4ee7-b775-279d7c357878]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c9456-e16f-4ff2-988f-55d861a24164]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0829902c-4518-4fd9-af61-4e2f15988ad3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[29143997-52a8-4d17-b75e-a08767ea9746]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-changed-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Refreshing instance network info cache due to event network-changed-fe0485d2-87fd-4758-a55c-8d8c180a6dee. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] Acquiring lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] Acquired lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.network.neutron [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Refreshing network info cache for port fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:13 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f91ca-d7d1-4ee6-bfba-5c2e0524ef15]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.utils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating existing volume attachment record: f91c318c-d44a-4744-8736-8cf7265baa31 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537113.6228497, 8fba4b8e-8a40-473a-9fc2-2d06ec128463 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:25:13 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Successfully detached device vdb from instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 from the live domain config.
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQBlrAdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:13 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8d660-36db-44a4-abc0-60b5b752d147]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "139270d7-7024-4397-a005-618e17165718" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "139270d7-7024-4397-a005-618e17165718-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:13 user nova-compute[72405]: INFO nova.compute.manager [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Terminating instance
Aug 08 23:25:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[769335de-faaf-4103-9b7d-51c18bda57c1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:13 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb980bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a'): ({'sdi'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Removing single pathed devices sdi {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[756be1c2-d736-43c8-93bd-c7e8a27c4b07]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd5439-503b-4596-b9db-ab581612b5ef]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Flushing IO for device /dev/sdi {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f59f601-76d8-4ec2-b154-00bf00173573]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.072s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb4a06-21d0-44d3-8b29-2edbd5595ab6]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] SCSI volumes sdi have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1629eb4-6c7e-40d7-9120-32df5cec5e1d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[30096c10-9e72-4358-97ad-3e168abc6091]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260]
Aug 08 23:25:14 user nova-compute[72405]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-de132b25-9c6e-43e3-bbec-073350a9c5e7 req-0efb4a20-e45f-4220-92a5-dabb5901c2f6 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-vif-unplugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de132b25-9c6e-43e3-bbec-073350a9c5e7 req-0efb4a20-e45f-4220-92a5-dabb5901c2f6 service nova] Acquiring lock "139270d7-7024-4397-a005-618e17165718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de132b25-9c6e-43e3-bbec-073350a9c5e7 req-0efb4a20-e45f-4220-92a5-dabb5901c2f6 service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de132b25-9c6e-43e3-bbec-073350a9c5e7 req-0efb4a20-e45f-4220-92a5-dabb5901c2f6 service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-de132b25-9c6e-43e3-bbec-073350a9c5e7 req-0efb4a20-e45f-4220-92a5-dabb5901c2f6 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] No waiting events found dispatching network-vif-unplugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-de132b25-9c6e-43e3-bbec-073350a9c5e7 req-0efb4a20-e45f-4220-92a5-dabb5901c2f6 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-vif-unplugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8d53dd-4fd6-4350-8fac-5e741936053a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[73768a59-8de7-449e-b217-8453d9354b66]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] <== disconnect_volume: return (422ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updated VIF entry in instance network info cache for port fe0485d2-87fd-4758-a55c-8d8c180a6dee. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updating instance_info_cache with network_info: [{"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e692099f-b000-4396-8757-6c560fec5caf req-de624f3a-af2a-4218-b4c3-9a115dac8ce0 service nova] Releasing lock "refresh_cache-6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 139270d7-7024-4397-a005-618e17165718] Instance destroyed successfully.
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.objects.instance [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lazy-loading 'resources' on Instance uuid 139270d7-7024-4397-a005-618e17165718 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1985319289',display_name='tempest-AttachSCSIVolumeTestJSON-server-1985319289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1985319289',id=6,image_ref='fb5062c4-5e74-4d87-9f17-faf18efde395',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPf/H+Jr3bks+3QJdPEnaIn6mgjQZ+3+XP7R6CbgfwB+ipqI/ArOAIDRcsB715AXn60yOv7E+lUmn+u+KfTMOGRrdnHQ0+m9YuKP8o2XnEFbkqY+oiN4jyZ+uw68X5cog==',key_name='tempest-keypair-1976994048',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2af46e92617d4d34b57ac1267eb1ed35',ramdisk_id='',reservation_id='r-3bwgtp0j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb5062c4-5e74-4d87-9f17-faf18efde395',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-773745210',owner_user_name='tempest-AttachSCSIVolumeTestJSON-773745210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9478bdd596664d2fbbc76949a2184097',uuid=139270d7-7024-4397-a005-618e17165718,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Converting VIF {"id": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "address": "fa:16:3e:2f:1b:85", "network": {"id": "d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-789766376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af46e92617d4d34b57ac1267eb1ed35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886e7e28-cb", "ovs_interfaceid": "886e7e28-cba5-4fdd-956e-b2b1a1ca7d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG os_vif [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap886e7e28-cb, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:14 user nova-compute[72405]: INFO os_vif [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=886e7e28-cba5-4fdd-956e-b2b1a1ca7d06,network=Network(d68dea75-3bf7-4ee1-9e65-a2feeeebcf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886e7e28-cb')
Aug 08 23:25:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Deleting instance files /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718_del
Aug 08 23:25:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Deletion of /opt/stack/data/nova/instances/139270d7-7024-4397-a005-618e17165718_del complete
Aug 08 23:25:14 user nova-compute[72405]: INFO nova.compute.manager [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] [instance: 139270d7-7024-4397-a005-618e17165718] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 139270d7-7024-4397-a005-618e17165718] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 139270d7-7024-4397-a005-618e17165718] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-254917a1-9708-46aa-828e-ad7d73d17d04 req-82dddd16-deb5-4ce4-99e3-bdb3e2fea991 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-254917a1-9708-46aa-828e-ad7d73d17d04 req-82dddd16-deb5-4ce4-99e3-bdb3e2fea991 service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-254917a1-9708-46aa-828e-ad7d73d17d04 req-82dddd16-deb5-4ce4-99e3-bdb3e2fea991 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-254917a1-9708-46aa-828e-ad7d73d17d04 req-82dddd16-deb5-4ce4-99e3-bdb3e2fea991 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-254917a1-9708-46aa-828e-ad7d73d17d04 req-82dddd16-deb5-4ce4-99e3-bdb3e2fea991 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:14 user nova-compute[72405]: WARNING nova.compute.manager [req-254917a1-9708-46aa-828e-ad7d73d17d04 req-82dddd16-deb5-4ce4-99e3-bdb3e2fea991 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 for instance with vm_state active and task_state None.
Aug 08 23:25:14 user nova-compute[72405]: DEBUG nova.objects.instance [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'flavor' on Instance uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-80970681-224e-4a1c-b51b-c7b769583eb6 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.966s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lazy-loading 'flavor' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:15 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 139270d7-7024-4397-a005-618e17165718] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:16 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 139270d7-7024-4397-a005-618e17165718] Took 1.38 seconds to deallocate network for instance.
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-5df96a4d-9adc-44d3-97a3-83adda75e633 req-71d440a2-9a5b-46ee-8ec9-e964483167ad service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-vif-deleted-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:16 user nova-compute[72405]: INFO nova.compute.manager [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Attaching volume fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 to /dev/vdb
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received event network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] Acquiring lock "139270d7-7024-4397-a005-618e17165718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] Lock "139270d7-7024-4397-a005-618e17165718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] No waiting events found dispatching network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:16 user nova-compute[72405]: WARNING nova.compute.manager [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 139270d7-7024-4397-a005-618e17165718] Received unexpected event network-vif-plugged-886e7e28-cba5-4fdd-956e-b2b1a1ca7d06 for instance with vm_state active and task_state deleting.
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-changed-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Refreshing instance network info cache due to event network-changed-92830d91-3d6e-44a6-98fa-048cc0b5d459. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] Acquiring lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] Acquired lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Refreshing network info cache for port 92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG os_brick.utils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18498e-a24f-4279-ba68-b2f9e1972198]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5f559-bcb1-410d-b085-ad164183431d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e59bdfb-16be-44b8-bc7b-e767afd57580]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e665a0-d0ac-4e56-951b-bf3f62504444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:16 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a1777-7608-4113-b864-e63c31e7464c]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG os_brick.utils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updating existing volume attachment record: f91daf59-db15-48eb-87da-2610af7c676b {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:16 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Deleted allocations for instance 139270d7-7024-4397-a005-618e17165718
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aa0740ae-41db-4de5-8bcf-7c133d2d6311 tempest-AttachSCSIVolumeTestJSON-773745210 tempest-AttachSCSIVolumeTestJSON-773745210-project-member] Lock "139270d7-7024-4397-a005-618e17165718" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.040s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updated VIF entry in instance network info cache for port 92830d91-3d6e-44a6-98fa-048cc0b5d459. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updating instance_info_cache with network_info: [{"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a3d66f78-959a-4ba8-b544-ae32e7c95236 req-1198b5c5-1b74-447b-8f8d-68b0c246a493 service nova] Releasing lock "refresh_cache-760574b8-2c65-4bb3-9ea6-1462bd32774b" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSLzhFbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:22 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:22 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:22 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260" returned: 21 in 0.047s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[432de0e2-5371-4489-9901-34d017609122]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:22 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d745fba-354c-4caf-a91f-29f6615ca785]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07] added
Aug 08 23:25:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0fb05c-3d2c-48a3-8505-825007fcbeb2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a059aa-5ab5-47f3-b650-d2c76cd5dd77]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSLzhFbU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSLzhFbU" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a52632-6311-405d-b887-03aed72b63ab]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GSLzhFbU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[783cb0b5-3a3b-4c6b-a709-66b0dcb98062]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361ea8b-f126-42f5-a3e5-db8617e95685]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69ba8e-5d77-4b34-af26-5662bb02da76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260]
Aug 08 23:25:22 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.148s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f08d3a-bd08-49d4-83f3-0a82aaf8c932]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcfea29-e877-4a7e-a8ad-dd9ea2ea4029]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:22 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9962231c-5d0a-4f74-bd52-129203bdf227]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSLzhFbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEAavCkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:22 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] <== connect_volume: return (1516ms) {'type': 'block', 'scsi_wwn': '23762643765386632', 'path': '/dev/sdh'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762643765386632', 'path': '/dev/sdh'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.967s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:23 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:23 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lazy-loading 'flavor' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6ec69c-e137-4c51-9ec9-71298c3d8b25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:23 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a64f33c-e653-4d63-a296-94d574ccd876]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767] added
Aug 08 23:25:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] attach device xml: <disk type="block" device="disk">
Aug 08 23:25:23 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:23 user nova-compute[72405]:   <source dev="/dev/sdh"/>
Aug 08 23:25:23 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:23 user nova-compute[72405]:   <serial>5e0bc637-777f-4982-b80b-4d8fdaa4ed07</serial>
Aug 08 23:25:23 user nova-compute[72405]: </disk>
Aug 08 23:25:23 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a0347-3e2a-49fd-88da-e8359ac4abe8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff55d1e8-5b5e-42db-bc15-2a3b9c6e9b06]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEAavCkd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEAavCkd" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4d782-fdc3-4aff-9ba0-9840cdb78650]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEAavCkd'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f6f77c-f03c-47e8-8619-4efa2a346184]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4b620e-4102-4fb4-b1d9-f0f1d24c801f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:23 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf7ebb5-5852-48c6-bfa9-a707d234f1a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260]
Aug 08 23:25:24 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:24 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[da98f036-610a-4218-90a2-b4b31774365e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad0fad-05c1-4fea-8cc9-dd91df15ab74]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:24 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:24 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e379596-a442-42b0-9da8-643ddc2f96d5]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEAavCkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] No VIF found with MAC fa:16:3e:33:4d:d2, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c65420e6-8635-4558-8130-ce265325562e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.430s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] volume_snapshot_create: create_info: {'snapshot_id': 'eccf00ee-021a-425a-acb0-ed4e0bb7de92', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72405) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] snap xml: <domainsnapshot>
Aug 08 23:25:24 user nova-compute[72405]:   <disks>
Aug 08 23:25:24 user nova-compute[72405]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 08 23:25:24 user nova-compute[72405]:       <source file="/dev/new_file"/>
Aug 08 23:25:24 user nova-compute[72405]:     </disk>
Aug 08 23:25:24 user nova-compute[72405]:     <disk name="vda" snapshot="no"/>
Aug 08 23:25:24 user nova-compute[72405]:   </disks>
Aug 08 23:25:24 user nova-compute[72405]: </domainsnapshot>
Aug 08 23:25:24 user nova-compute[72405]:  {{(pid=72405) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lazy-loading 'system_metadata' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:24 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     rv = execute(f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     six.reraise(c, e, tb)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     raise value
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     rv = meth(*args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     self._volume_snapshot_create(context, instance, guest,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     rv = execute(f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     six.reraise(c, e, tb)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     raise value
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     rv = meth(*args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] 
Aug 08 23:25:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ea565ebe-4f89-46c8-bc1c-254ba53808c4 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] volume_snapshot_delete: delete_info: {'volume_id': '5e0bc637-777f-4982-b80b-4d8fdaa4ed07'} {{(pid=72405) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [None req-ea565ebe-4f89-46c8-bc1c-254ba53808c4 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb]     if delete_info['type'] != 'qcow2':
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] KeyError: 'type'
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot eccf00ee-021a-425a-acb0-ed4e0bb7de92 could not be found.
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise value
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot eccf00ee-021a-425a-acb0-ed4e0bb7de92 could not be found. (HTTP 404) (Request-ID: req-87989df7-df08-48bc-9b4b-9c0e1998890d)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot eccf00ee-021a-425a-acb0-ed4e0bb7de92 could not be found.
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver [None req-ea565ebe-4f89-46c8-bc1c-254ba53808c4 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d2d788db-76d9-4d47-a51e-769afc5fffa4)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 08 23:25:24 user nova-compute[72405]: ERROR nova.virt.libvirt.driver 
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server [None req-b8d86e13-990d-4de2-b812-6a0986e2f59e tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     raise value
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server 
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server [None req-ea565ebe-4f89-46c8-bc1c-254ba53808c4 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Exception during message handling: KeyError: 'type'
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 08 23:25:24 user nova-compute[72405]: ERROR oslo_messaging.rpc.server 
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:25 user nova-compute[72405]: INFO nova.compute.manager [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Detaching volume 5e0bc637-777f-4982-b80b-4d8fdaa4ed07
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] <== connect_volume: return (2309ms) {'type': 'block', 'scsi_wwn': '23130316437373637', 'path': '/dev/sdi'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130316437373637', 'path': '/dev/sdi'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'flavor' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:25:25 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:25 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:25:25 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:25 user nova-compute[72405]:   <serial>b0e71e35-f430-4448-ada5-64550dffd767</serial>
Aug 08 23:25:25 user nova-compute[72405]: </disk>
Aug 08 23:25:25 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:25:25 user nova-compute[72405]: INFO nova.virt.block_device [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Attempting to driver detach volume 5e0bc637-777f-4982-b80b-4d8fdaa4ed07 from mountpoint /dev/vdb
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Attempting to detach device vdb from instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:25 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:25 user nova-compute[72405]:   <source dev="/dev/sdh"/>
Aug 08 23:25:25 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:25 user nova-compute[72405]:   <serial>5e0bc637-777f-4982-b80b-4d8fdaa4ed07</serial>
Aug 08 23:25:25 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:25:25 user nova-compute[72405]: </disk>
Aug 08 23:25:25 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Successfully detached device vdb from instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb from the persistent domain config.
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:25 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:25 user nova-compute[72405]:   <source dev="/dev/sdh"/>
Aug 08 23:25:25 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:25 user nova-compute[72405]:   <serial>5e0bc637-777f-4982-b80b-4d8fdaa4ed07</serial>
Aug 08 23:25:25 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:25:25 user nova-compute[72405]: </disk>
Aug 08 23:25:25 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:25 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No BDM found with device name hda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] No VIF found with MAC fa:16:3e:b0:85:4a, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a212146b-889a-4098-93d4-257209d63d94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:25 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaae8ce1-c7a9-442a-989b-368668b2c068]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8] added
Aug 08 23:25:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc250e2e-5c48-4e2c-8000-f4eda105cecb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[352849a1-6803-49ec-88c8-60c2a4a1c546]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNVGaPut {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNVGaPut" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[017760fe-19b5-4185-838e-50c16a3572e4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNVGaPut'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fc79e5ee-31f9-4446-a647-652d4e693c32 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.364s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d10129a-7ab2-4032-a90d-a347487ef39b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a84b77-b892-42e4-95c5-d467bfbf795d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c3b00-3c99-4089-b4f8-e044dbf49f56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]
Aug 08 23:25:25 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537125.8760865, 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:25:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Successfully detached device vdb from instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb from the live domain config.
Aug 08 23:25:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSLzhFbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949655a-c700-4bb7-a48f-2ed749a8d7ca]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16ad6a-c846-492d-a48e-18dd435bf0d7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:25 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a36ccb-4cfe-405a-8191-5bab158ed084]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23565363936336537', 'path': '/dev/sdj'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565363936336537', 'path': '/dev/sdj'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.086s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lazy-loading 'flavor' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[93df95a1-77a3-461b-a41b-b3bd7c6b4fab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:25:27 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:27 user nova-compute[72405]:   <source dev="/dev/sdj"/>
Aug 08 23:25:27 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:27 user nova-compute[72405]:   <serial>fd24ae3c-7fa6-4fbc-9094-59a4041f27b8</serial>
Aug 08 23:25:27 user nova-compute[72405]: </disk>
Aug 08 23:25:27 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b5373-cc97-4f6c-b7a9-043a7375617a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781991b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07'): ({'sdh'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Removing single pathed devices sdh {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad772fe-4594-4f53-9798-dfc5903a7745]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d237d-ad17-453f-9b36-99aae9950a8a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Flushing IO for device /dev/sdh {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c13ad68-af06-4b6e-b2f0-68e39597fa98]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07229f6-8281-4d74-a153-f4ee7c38fc4e]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] SCSI volumes sdh have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f89aa-4267-4de3-8dc2-4805524b149e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9bc5fc-4038-420a-b56b-1beb007b3582]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260]
Aug 08 23:25:27 user nova-compute[72405]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0bc637-777f-4982-b80b-4d8fdaa4ed07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9590eb0-c9cf-4441-b768-18db27dcd081]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] <== disconnect_volume: return (1429ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:27 user nova-compute[72405]: INFO nova.compute.manager [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Detaching volume b0e71e35-f430-4448-ada5-64550dffd767
Aug 08 23:25:27 user nova-compute[72405]: INFO nova.virt.block_device [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Attempting to driver detach volume b0e71e35-f430-4448-ada5-64550dffd767 from mountpoint /dev/vdb
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Attempting to detach device vdb from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:27 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:27 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:25:27 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:27 user nova-compute[72405]:   <serial>b0e71e35-f430-4448-ada5-64550dffd767</serial>
Aug 08 23:25:27 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 08 23:25:27 user nova-compute[72405]: </disk>
Aug 08 23:25:27 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully detached device vdb from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the persistent domain config.
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:25:27 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:25:27 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:25:27 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:25:27 user nova-compute[72405]:   <serial>b0e71e35-f430-4448-ada5-64550dffd767</serial>
Aug 08 23:25:27 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 08 23:25:27 user nova-compute[72405]: </disk>
Aug 08 23:25:27 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] No VIF found with MAC fa:16:3e:b6:36:de, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2c2d2d54-abe5-4e23-8739-6812ca3a00f9 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.485s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537127.8465106, 29c4e0e6-85dc-4db6-a801-2ff6a19115db => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:25:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully detached device vdb from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the live domain config.
Aug 08 23:25:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEAavCkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:27 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d33603-6cc9-45a7-aa76-933b15f3571a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8787b6a-4c97-42a8-8e4e-590ca0fa585f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:27 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9808ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767'): ({'sdi'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Removing single pathed devices sdi {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec36077b-faae-4599-8ab3-ce6d9f14ce88]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d646a3ea-5f96-4607-82cc-ce3c66fb2bfd]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Flushing IO for device /dev/sdi {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f34d5d-b831-4321-ba2e-932a1cd4cc5e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc240584-c4fe-4945-a5ff-f317ac5ffcb6]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] SCSI volumes sdi have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5a423b-264a-4f4e-8b07-b526eb586203]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.utils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lazy-loading 'flavor' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc8bd38-1647-4726-a175-63251c57326a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ceddda-57ae-4821-890c-f9b4969c2bd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efb6554-50ee-4ec2-b26b-0e6370f7792f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260]
Aug 08 23:25:28 user nova-compute[72405]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:28 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bed88b89-0468-4484-8388-cf310c1ac292 tempest-VolumesAssistedSnapshotsTest-1400391399 tempest-VolumesAssistedSnapshotsTest-1400391399-project-admin] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.094s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7c2b1b-0ba5-4a7d-af06-8bd3316888f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610a3d8-bb53-476a-9267-b72e97be8635]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e71e35-f430-4448-ada5-64550dffd767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d896a26-425e-46eb-aa88-57a72ce3de8e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] <== disconnect_volume: return (390ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:28 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c06cb8-4e32-458c-bc17-c0f5f478619a]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG os_brick.utils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:28 user nova-compute[72405]: INFO nova.compute.manager [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Swapping volume fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 for b5aed676-1610-4849-beda-1e67de74a8ea
Aug 08 23:25:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'flavor' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-78a3b69d-389a-4712-8044-bee6d61bbb92 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537114.5133667, 139270d7-7024-4397-a005-618e17165718 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:29 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 139270d7-7024-4397-a005-618e17165718] VM Stopped (Lifecycle Event)
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b30070e8-3ee0-4516-b99f-6b96d314679a None None] [instance: 139270d7-7024-4397-a005-618e17165718] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-changed-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Refreshing instance network info cache due to event network-changed-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] Acquiring lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] Acquired lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Refreshing network info cache for port 9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "interface-29c4e0e6-85dc-4db6-a801-2ff6a19115db-5db510f5-38c3-4a81-934b-e1ab20e1db31" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "interface-29c4e0e6-85dc-4db6-a801-2ff6a19115db-5db510f5-38c3-4a81-934b-e1ab20e1db31" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'flavor' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:a8:43"/><model type="virtio"/><mtu size="1442"/><target dev="tap5db510f5-38"/></interface> {{(pid=72405) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:a8:43"/><model type="virtio"/><mtu size="1442"/><target dev="tap5db510f5-38"/></interface> {{(pid=72405) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Attempting to detach device tap5db510f5-38 from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] detach device xml: <interface type="ethernet">
Aug 08 23:25:29 user nova-compute[72405]:   <mac address="fa:16:3e:05:a8:43"/>
Aug 08 23:25:29 user nova-compute[72405]:   <model type="virtio"/>
Aug 08 23:25:29 user nova-compute[72405]:   <mtu size="1442"/>
Aug 08 23:25:29 user nova-compute[72405]:   <target dev="tap5db510f5-38"/>
Aug 08 23:25:29 user nova-compute[72405]: </interface>
Aug 08 23:25:29 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:a8:43"/><model type="virtio"/><mtu size="1442"/><target dev="tap5db510f5-38"/></interface> {{(pid=72405) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:a8:43"/><model type="virtio"/><mtu size="1442"/><target dev="tap5db510f5-38"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 08 23:25:29 user nova-compute[72405]:   <name>instance-00000008</name>
Aug 08 23:25:29 user nova-compute[72405]:   <uuid>29c4e0e6-85dc-4db6-a801-2ff6a19115db</uuid>
Aug 08 23:25:29 user nova-compute[72405]:   <metadata>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:25:29 user nova-compute[72405]:   <nova:package version="0.0.0"/>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:name>tempest-device-tagging-server-714913135</nova:name>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:creationTime>2023-08-08 23:25:12</nova:creationTime>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:flavor name="m1.tiny">
Aug 08 23:25:29 user nova-compute[72405]:     <nova:memory>512</nova:memory>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:disk>1</nova:disk>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:swap>0</nova:swap>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:vcpus>1</nova:vcpus>
Aug 08 23:25:29 user nova-compute[72405]:   </nova:flavor>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:owner>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:user uuid="d1da7c19e65443d49ebd11d20955166f">tempest-TaggedAttachmentsTest-628633788-project-member</nova:user>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:project uuid="4229ea3198b846819520ed06edf0eecd">tempest-TaggedAttachmentsTest-628633788</nova:project>
Aug 08 23:25:29 user nova-compute[72405]:   </nova:owner>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:ports>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:port uuid="67827618-228c-474c-adaf-4692e1251fc1">
Aug 08 23:25:29 user nova-compute[72405]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:25:29 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:port uuid="5db510f5-38c3-4a81-934b-e1ab20e1db31">
Aug 08 23:25:29 user nova-compute[72405]:       <nova:ip type="fixed" address="10.10.10.200" ipVersion="4"/>
Aug 08 23:25:29 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:29 user nova-compute[72405]:   </nova:ports>
Aug 08 23:25:29 user nova-compute[72405]: </nova:instance>
Aug 08 23:25:29 user nova-compute[72405]:   </metadata>
Aug 08 23:25:29 user nova-compute[72405]:   <memory unit='KiB'>524288</memory>
Aug 08 23:25:29 user nova-compute[72405]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 08 23:25:29 user nova-compute[72405]:   <vcpu placement='static'>1</vcpu>
Aug 08 23:25:29 user nova-compute[72405]:   <resource>
Aug 08 23:25:29 user nova-compute[72405]:     <partition>/machine</partition>
Aug 08 23:25:29 user nova-compute[72405]:   </resource>
Aug 08 23:25:29 user nova-compute[72405]:   <sysinfo type='smbios'>
Aug 08 23:25:29 user nova-compute[72405]:     <system>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='product'>OpenStack Nova</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='version'>0.0.0</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='serial'>29c4e0e6-85dc-4db6-a801-2ff6a19115db</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='uuid'>29c4e0e6-85dc-4db6-a801-2ff6a19115db</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='family'>Virtual Machine</entry>
Aug 08 23:25:29 user nova-compute[72405]:     </system>
Aug 08 23:25:29 user nova-compute[72405]:   </sysinfo>
Aug 08 23:25:29 user nova-compute[72405]:   <os>
Aug 08 23:25:29 user nova-compute[72405]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 08 23:25:29 user nova-compute[72405]:     <boot dev='hd'/>
Aug 08 23:25:29 user nova-compute[72405]:     <smbios mode='sysinfo'/>
Aug 08 23:25:29 user nova-compute[72405]:   </os>
Aug 08 23:25:29 user nova-compute[72405]:   <features>
Aug 08 23:25:29 user nova-compute[72405]:     <acpi/>
Aug 08 23:25:29 user nova-compute[72405]:     <apic/>
Aug 08 23:25:29 user nova-compute[72405]:     <vmcoreinfo state='on'/>
Aug 08 23:25:29 user nova-compute[72405]:   </features>
Aug 08 23:25:29 user nova-compute[72405]:   <cpu mode='custom' match='exact' check='full'>
Aug 08 23:25:29 user nova-compute[72405]:     <model fallback='forbid'>Nehalem</model>
Aug 08 23:25:29 user nova-compute[72405]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 08 23:25:29 user nova-compute[72405]:     <feature policy='require' name='vme'/>
Aug 08 23:25:29 user nova-compute[72405]:     <feature policy='require' name='x2apic'/>
Aug 08 23:25:29 user nova-compute[72405]:     <feature policy='require' name='hypervisor'/>
Aug 08 23:25:29 user nova-compute[72405]:   </cpu>
Aug 08 23:25:29 user nova-compute[72405]:   <clock offset='utc'>
Aug 08 23:25:29 user nova-compute[72405]:     <timer name='pit' tickpolicy='delay'/>
Aug 08 23:25:29 user nova-compute[72405]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 08 23:25:29 user nova-compute[72405]:     <timer name='hpet' present='no'/>
Aug 08 23:25:29 user nova-compute[72405]:   </clock>
Aug 08 23:25:29 user nova-compute[72405]:   <on_poweroff>destroy</on_poweroff>
Aug 08 23:25:29 user nova-compute[72405]:   <on_reboot>restart</on_reboot>
Aug 08 23:25:29 user nova-compute[72405]:   <on_crash>destroy</on_crash>
Aug 08 23:25:29 user nova-compute[72405]:   <devices>
Aug 08 23:25:29 user nova-compute[72405]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 08 23:25:29 user nova-compute[72405]:     <disk type='file' device='disk'>
Aug 08 23:25:29 user nova-compute[72405]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 08 23:25:29 user nova-compute[72405]:       <source file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk' index='2'/>
Aug 08 23:25:29 user nova-compute[72405]:       <backingStore type='file' index='3'>
Aug 08 23:25:29 user nova-compute[72405]:         <format type='raw'/>
Aug 08 23:25:29 user nova-compute[72405]:         <source file='/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b'/>
Aug 08 23:25:29 user nova-compute[72405]:         <backingStore/>
Aug 08 23:25:29 user nova-compute[72405]:       </backingStore>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='vda' bus='virtio'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='virtio-disk0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </disk>
Aug 08 23:25:29 user nova-compute[72405]:     <disk type='file' device='cdrom'>
Aug 08 23:25:29 user nova-compute[72405]:       <driver name='qemu' type='raw' cache='none'/>
Aug 08 23:25:29 user nova-compute[72405]:       <source file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.config' index='1'/>
Aug 08 23:25:29 user nova-compute[72405]:       <backingStore/>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='hda' bus='ide'/>
Aug 08 23:25:29 user nova-compute[72405]:       <readonly/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='ide0-0-0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </disk>
Aug 08 23:25:29 user nova-compute[72405]:     <controller type='usb' index='0' model='none'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='usb'/>
Aug 08 23:25:29 user nova-compute[72405]:     </controller>
Aug 08 23:25:29 user nova-compute[72405]:     <controller type='pci' index='0' model='pci-root'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='pci.0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </controller>
Aug 08 23:25:29 user nova-compute[72405]:     <controller type='ide' index='0'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='ide'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 08 23:25:29 user nova-compute[72405]:     </controller>
Aug 08 23:25:29 user nova-compute[72405]:     <interface type='ethernet'>
Aug 08 23:25:29 user nova-compute[72405]:       <mac address='fa:16:3e:b0:85:4a'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='tap67827618-22'/>
Aug 08 23:25:29 user nova-compute[72405]:       <model type='virtio'/>
Aug 08 23:25:29 user nova-compute[72405]:       <mtu size='1442'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='net0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </interface>
Aug 08 23:25:29 user nova-compute[72405]:     <interface type='ethernet'>
Aug 08 23:25:29 user nova-compute[72405]:       <mac address='fa:16:3e:05:a8:43'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='tap5db510f5-38'/>
Aug 08 23:25:29 user nova-compute[72405]:       <model type='virtio'/>
Aug 08 23:25:29 user nova-compute[72405]:       <mtu size='1442'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='net1'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </interface>
Aug 08 23:25:29 user nova-compute[72405]:     <serial type='pty'>
Aug 08 23:25:29 user nova-compute[72405]:       <source path='/dev/pts/7'/>
Aug 08 23:25:29 user nova-compute[72405]:       <log file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/console.log' append='off'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target type='isa-serial' port='0'>
Aug 08 23:25:29 user nova-compute[72405]:         <model name='isa-serial'/>
Aug 08 23:25:29 user nova-compute[72405]:       </target>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='serial0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </serial>
Aug 08 23:25:29 user nova-compute[72405]:     <console type='pty' tty='/dev/pts/7'>
Aug 08 23:25:29 user nova-compute[72405]:       <source path='/dev/pts/7'/>
Aug 08 23:25:29 user nova-compute[72405]:       <log file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/console.log' append='off'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target type='serial' port='0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='serial0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </console>
Aug 08 23:25:29 user nova-compute[72405]:     <input type='mouse' bus='ps2'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='input0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </input>
Aug 08 23:25:29 user nova-compute[72405]:     <input type='keyboard' bus='ps2'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='input1'/>
Aug 08 23:25:29 user nova-compute[72405]:     </input>
Aug 08 23:25:29 user nova-compute[72405]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 08 23:25:29 user nova-compute[72405]:       <listen type='address' address='0.0.0.0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </graphics>
Aug 08 23:25:29 user nova-compute[72405]:     <audio id='1' type='none'/>
Aug 08 23:25:29 user nova-compute[72405]:     <video>
Aug 08 23:25:29 user nova-compute[72405]:       <model type='virtio' heads='1' primary='yes'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='video0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </video>
Aug 08 23:25:29 user nova-compute[72405]:     <memballoon model='virtio'>
Aug 08 23:25:29 user nova-compute[72405]:       <stats period='10'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='balloon0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </memballoon>
Aug 08 23:25:29 user nova-compute[72405]:     <rng model='virtio'>
Aug 08 23:25:29 user nova-compute[72405]:       <backend model='random'>/dev/urandom</backend>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='rng0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </rng>
Aug 08 23:25:29 user nova-compute[72405]:   </devices>
Aug 08 23:25:29 user nova-compute[72405]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 08 23:25:29 user nova-compute[72405]:     <label>libvirt-29c4e0e6-85dc-4db6-a801-2ff6a19115db</label>
Aug 08 23:25:29 user nova-compute[72405]:     <imagelabel>libvirt-29c4e0e6-85dc-4db6-a801-2ff6a19115db</imagelabel>
Aug 08 23:25:29 user nova-compute[72405]:   </seclabel>
Aug 08 23:25:29 user nova-compute[72405]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 08 23:25:29 user nova-compute[72405]:     <label>+64055:+108</label>
Aug 08 23:25:29 user nova-compute[72405]:     <imagelabel>+64055:+108</imagelabel>
Aug 08 23:25:29 user nova-compute[72405]:   </seclabel>
Aug 08 23:25:29 user nova-compute[72405]: </domain>
Aug 08 23:25:29 user nova-compute[72405]:  {{(pid=72405) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 08 23:25:29 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully detached device tap5db510f5-38 from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the persistent domain config.
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] (1/8): Attempting to detach device tap5db510f5-38 with device alias net1 from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] detach device xml: <interface type="ethernet">
Aug 08 23:25:29 user nova-compute[72405]:   <mac address="fa:16:3e:05:a8:43"/>
Aug 08 23:25:29 user nova-compute[72405]:   <model type="virtio"/>
Aug 08 23:25:29 user nova-compute[72405]:   <mtu size="1442"/>
Aug 08 23:25:29 user nova-compute[72405]:   <target dev="tap5db510f5-38"/>
Aug 08 23:25:29 user nova-compute[72405]: </interface>
Aug 08 23:25:29 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537129.9615905, 29c4e0e6-85dc-4db6-a801-2ff6a19115db => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Start waiting for the detach event from libvirt for device tap5db510f5-38 with device alias net1 for instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:a8:43"/><model type="virtio"/><mtu size="1442"/><target dev="tap5db510f5-38"/></interface> {{(pid=72405) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:a8:43"/><model type="virtio"/><mtu size="1442"/><target dev="tap5db510f5-38"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 08 23:25:29 user nova-compute[72405]:   <name>instance-00000008</name>
Aug 08 23:25:29 user nova-compute[72405]:   <uuid>29c4e0e6-85dc-4db6-a801-2ff6a19115db</uuid>
Aug 08 23:25:29 user nova-compute[72405]:   <metadata>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:25:29 user nova-compute[72405]:   <nova:package version="0.0.0"/>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:name>tempest-device-tagging-server-714913135</nova:name>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:creationTime>2023-08-08 23:25:12</nova:creationTime>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:flavor name="m1.tiny">
Aug 08 23:25:29 user nova-compute[72405]:     <nova:memory>512</nova:memory>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:disk>1</nova:disk>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:swap>0</nova:swap>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:vcpus>1</nova:vcpus>
Aug 08 23:25:29 user nova-compute[72405]:   </nova:flavor>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:owner>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:user uuid="d1da7c19e65443d49ebd11d20955166f">tempest-TaggedAttachmentsTest-628633788-project-member</nova:user>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:project uuid="4229ea3198b846819520ed06edf0eecd">tempest-TaggedAttachmentsTest-628633788</nova:project>
Aug 08 23:25:29 user nova-compute[72405]:   </nova:owner>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:25:29 user nova-compute[72405]:   <nova:ports>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:port uuid="67827618-228c-474c-adaf-4692e1251fc1">
Aug 08 23:25:29 user nova-compute[72405]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:25:29 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:29 user nova-compute[72405]:     <nova:port uuid="5db510f5-38c3-4a81-934b-e1ab20e1db31">
Aug 08 23:25:29 user nova-compute[72405]:       <nova:ip type="fixed" address="10.10.10.200" ipVersion="4"/>
Aug 08 23:25:29 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:29 user nova-compute[72405]:   </nova:ports>
Aug 08 23:25:29 user nova-compute[72405]: </nova:instance>
Aug 08 23:25:29 user nova-compute[72405]:   </metadata>
Aug 08 23:25:29 user nova-compute[72405]:   <memory unit='KiB'>524288</memory>
Aug 08 23:25:29 user nova-compute[72405]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 08 23:25:29 user nova-compute[72405]:   <vcpu placement='static'>1</vcpu>
Aug 08 23:25:29 user nova-compute[72405]:   <resource>
Aug 08 23:25:29 user nova-compute[72405]:     <partition>/machine</partition>
Aug 08 23:25:29 user nova-compute[72405]:   </resource>
Aug 08 23:25:29 user nova-compute[72405]:   <sysinfo type='smbios'>
Aug 08 23:25:29 user nova-compute[72405]:     <system>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='product'>OpenStack Nova</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='version'>0.0.0</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='serial'>29c4e0e6-85dc-4db6-a801-2ff6a19115db</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='uuid'>29c4e0e6-85dc-4db6-a801-2ff6a19115db</entry>
Aug 08 23:25:29 user nova-compute[72405]:       <entry name='family'>Virtual Machine</entry>
Aug 08 23:25:29 user nova-compute[72405]:     </system>
Aug 08 23:25:29 user nova-compute[72405]:   </sysinfo>
Aug 08 23:25:29 user nova-compute[72405]:   <os>
Aug 08 23:25:29 user nova-compute[72405]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 08 23:25:29 user nova-compute[72405]:     <boot dev='hd'/>
Aug 08 23:25:29 user nova-compute[72405]:     <smbios mode='sysinfo'/>
Aug 08 23:25:29 user nova-compute[72405]:   </os>
Aug 08 23:25:29 user nova-compute[72405]:   <features>
Aug 08 23:25:29 user nova-compute[72405]:     <acpi/>
Aug 08 23:25:29 user nova-compute[72405]:     <apic/>
Aug 08 23:25:29 user nova-compute[72405]:     <vmcoreinfo state='on'/>
Aug 08 23:25:29 user nova-compute[72405]:   </features>
Aug 08 23:25:29 user nova-compute[72405]:   <cpu mode='custom' match='exact' check='full'>
Aug 08 23:25:29 user nova-compute[72405]:     <model fallback='forbid'>Nehalem</model>
Aug 08 23:25:29 user nova-compute[72405]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 08 23:25:29 user nova-compute[72405]:     <feature policy='require' name='vme'/>
Aug 08 23:25:29 user nova-compute[72405]:     <feature policy='require' name='x2apic'/>
Aug 08 23:25:29 user nova-compute[72405]:     <feature policy='require' name='hypervisor'/>
Aug 08 23:25:29 user nova-compute[72405]:   </cpu>
Aug 08 23:25:29 user nova-compute[72405]:   <clock offset='utc'>
Aug 08 23:25:29 user nova-compute[72405]:     <timer name='pit' tickpolicy='delay'/>
Aug 08 23:25:29 user nova-compute[72405]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 08 23:25:29 user nova-compute[72405]:     <timer name='hpet' present='no'/>
Aug 08 23:25:29 user nova-compute[72405]:   </clock>
Aug 08 23:25:29 user nova-compute[72405]:   <on_poweroff>destroy</on_poweroff>
Aug 08 23:25:29 user nova-compute[72405]:   <on_reboot>restart</on_reboot>
Aug 08 23:25:29 user nova-compute[72405]:   <on_crash>destroy</on_crash>
Aug 08 23:25:29 user nova-compute[72405]:   <devices>
Aug 08 23:25:29 user nova-compute[72405]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 08 23:25:29 user nova-compute[72405]:     <disk type='file' device='disk'>
Aug 08 23:25:29 user nova-compute[72405]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 08 23:25:29 user nova-compute[72405]:       <source file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk' index='2'/>
Aug 08 23:25:29 user nova-compute[72405]:       <backingStore type='file' index='3'>
Aug 08 23:25:29 user nova-compute[72405]:         <format type='raw'/>
Aug 08 23:25:29 user nova-compute[72405]:         <source file='/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b'/>
Aug 08 23:25:29 user nova-compute[72405]:         <backingStore/>
Aug 08 23:25:29 user nova-compute[72405]:       </backingStore>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='vda' bus='virtio'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='virtio-disk0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </disk>
Aug 08 23:25:29 user nova-compute[72405]:     <disk type='file' device='cdrom'>
Aug 08 23:25:29 user nova-compute[72405]:       <driver name='qemu' type='raw' cache='none'/>
Aug 08 23:25:29 user nova-compute[72405]:       <source file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk.config' index='1'/>
Aug 08 23:25:29 user nova-compute[72405]:       <backingStore/>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='hda' bus='ide'/>
Aug 08 23:25:29 user nova-compute[72405]:       <readonly/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='ide0-0-0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </disk>
Aug 08 23:25:29 user nova-compute[72405]:     <controller type='usb' index='0' model='none'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='usb'/>
Aug 08 23:25:29 user nova-compute[72405]:     </controller>
Aug 08 23:25:29 user nova-compute[72405]:     <controller type='pci' index='0' model='pci-root'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='pci.0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </controller>
Aug 08 23:25:29 user nova-compute[72405]:     <controller type='ide' index='0'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='ide'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 08 23:25:29 user nova-compute[72405]:     </controller>
Aug 08 23:25:29 user nova-compute[72405]:     <interface type='ethernet'>
Aug 08 23:25:29 user nova-compute[72405]:       <mac address='fa:16:3e:b0:85:4a'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target dev='tap67827618-22'/>
Aug 08 23:25:29 user nova-compute[72405]:       <model type='virtio'/>
Aug 08 23:25:29 user nova-compute[72405]:       <mtu size='1442'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='net0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </interface>
Aug 08 23:25:29 user nova-compute[72405]:     <serial type='pty'>
Aug 08 23:25:29 user nova-compute[72405]:       <source path='/dev/pts/7'/>
Aug 08 23:25:29 user nova-compute[72405]:       <log file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/console.log' append='off'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target type='isa-serial' port='0'>
Aug 08 23:25:29 user nova-compute[72405]:         <model name='isa-serial'/>
Aug 08 23:25:29 user nova-compute[72405]:       </target>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='serial0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </serial>
Aug 08 23:25:29 user nova-compute[72405]:     <console type='pty' tty='/dev/pts/7'>
Aug 08 23:25:29 user nova-compute[72405]:       <source path='/dev/pts/7'/>
Aug 08 23:25:29 user nova-compute[72405]:       <log file='/opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/console.log' append='off'/>
Aug 08 23:25:29 user nova-compute[72405]:       <target type='serial' port='0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='serial0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </console>
Aug 08 23:25:29 user nova-compute[72405]:     <input type='mouse' bus='ps2'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='input0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </input>
Aug 08 23:25:29 user nova-compute[72405]:     <input type='keyboard' bus='ps2'>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='input1'/>
Aug 08 23:25:29 user nova-compute[72405]:     </input>
Aug 08 23:25:29 user nova-compute[72405]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 08 23:25:29 user nova-compute[72405]:       <listen type='address' address='0.0.0.0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </graphics>
Aug 08 23:25:29 user nova-compute[72405]:     <audio id='1' type='none'/>
Aug 08 23:25:29 user nova-compute[72405]:     <video>
Aug 08 23:25:29 user nova-compute[72405]:       <model type='virtio' heads='1' primary='yes'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='video0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </video>
Aug 08 23:25:29 user nova-compute[72405]:     <memballoon model='virtio'>
Aug 08 23:25:29 user nova-compute[72405]:       <stats period='10'/>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='balloon0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </memballoon>
Aug 08 23:25:29 user nova-compute[72405]:     <rng model='virtio'>
Aug 08 23:25:29 user nova-compute[72405]:       <backend model='random'>/dev/urandom</backend>
Aug 08 23:25:29 user nova-compute[72405]:       <alias name='rng0'/>
Aug 08 23:25:29 user nova-compute[72405]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 08 23:25:29 user nova-compute[72405]:     </rng>
Aug 08 23:25:29 user nova-compute[72405]:   </devices>
Aug 08 23:25:29 user nova-compute[72405]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 08 23:25:29 user nova-compute[72405]:     <label>libvirt-29c4e0e6-85dc-4db6-a801-2ff6a19115db</label>
Aug 08 23:25:29 user nova-compute[72405]:     <imagelabel>libvirt-29c4e0e6-85dc-4db6-a801-2ff6a19115db</imagelabel>
Aug 08 23:25:29 user nova-compute[72405]:   </seclabel>
Aug 08 23:25:29 user nova-compute[72405]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 08 23:25:29 user nova-compute[72405]:     <label>+64055:+108</label>
Aug 08 23:25:29 user nova-compute[72405]:     <imagelabel>+64055:+108</imagelabel>
Aug 08 23:25:29 user nova-compute[72405]:   </seclabel>
Aug 08 23:25:29 user nova-compute[72405]: </domain>
Aug 08 23:25:29 user nova-compute[72405]:  {{(pid=72405) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 08 23:25:29 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully detached device tap5db510f5-38 from instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db from the live domain config.
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "address": "fa:16:3e:05:a8:43", "network": {"id": "07efb0fa-5b08-4bec-a6e1-e785a7a50bd5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-587233292", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db510f5-38", "ovs_interfaceid": "5db510f5-38c3-4a81-934b-e1ab20e1db31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG os_vif [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db510f5-38, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:30 user nova-compute[72405]: INFO os_vif [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=5db510f5-38c3-4a81-934b-e1ab20e1db31,network=Network(07efb0fa-5b08-4bec-a6e1-e785a7a50bd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db510f5-38')
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:25:30 user nova-compute[72405]:   <nova:package version="0.0.0"/>
Aug 08 23:25:30 user nova-compute[72405]:   <nova:name>tempest-device-tagging-server-714913135</nova:name>
Aug 08 23:25:30 user nova-compute[72405]:   <nova:creationTime>2023-08-08 23:25:30</nova:creationTime>
Aug 08 23:25:30 user nova-compute[72405]:   <nova:flavor name="m1.tiny">
Aug 08 23:25:30 user nova-compute[72405]:     <nova:memory>512</nova:memory>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:disk>1</nova:disk>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:swap>0</nova:swap>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:vcpus>1</nova:vcpus>
Aug 08 23:25:30 user nova-compute[72405]:   </nova:flavor>
Aug 08 23:25:30 user nova-compute[72405]:   <nova:owner>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:user uuid="d1da7c19e65443d49ebd11d20955166f">tempest-TaggedAttachmentsTest-628633788-project-member</nova:user>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:project uuid="4229ea3198b846819520ed06edf0eecd">tempest-TaggedAttachmentsTest-628633788</nova:project>
Aug 08 23:25:30 user nova-compute[72405]:   </nova:owner>
Aug 08 23:25:30 user nova-compute[72405]:   <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:25:30 user nova-compute[72405]:   <nova:ports>
Aug 08 23:25:30 user nova-compute[72405]:     <nova:port uuid="67827618-228c-474c-adaf-4692e1251fc1">
Aug 08 23:25:30 user nova-compute[72405]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:25:30 user nova-compute[72405]:     </nova:port>
Aug 08 23:25:30 user nova-compute[72405]:   </nova:ports>
Aug 08 23:25:30 user nova-compute[72405]: </nova:instance>
Aug 08 23:25:30 user nova-compute[72405]:  {{(pid=72405) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-97b768cd-dc14-4dae-bb18-f6ad4bf7d46a req-8e013fc7-f51b-43d8-9cb9-af917d9dc1c7 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-unplugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-97b768cd-dc14-4dae-bb18-f6ad4bf7d46a req-8e013fc7-f51b-43d8-9cb9-af917d9dc1c7 service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-97b768cd-dc14-4dae-bb18-f6ad4bf7d46a req-8e013fc7-f51b-43d8-9cb9-af917d9dc1c7 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-97b768cd-dc14-4dae-bb18-f6ad4bf7d46a req-8e013fc7-f51b-43d8-9cb9-af917d9dc1c7 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-97b768cd-dc14-4dae-bb18-f6ad4bf7d46a req-8e013fc7-f51b-43d8-9cb9-af917d9dc1c7 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-unplugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:30 user nova-compute[72405]: WARNING nova.compute.manager [req-97b768cd-dc14-4dae-bb18-f6ad4bf7d46a req-8e013fc7-f51b-43d8-9cb9-af917d9dc1c7 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-unplugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 for instance with vm_state active and task_state None.
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:30 user nova-compute[72405]: INFO nova.compute.manager [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Rebuilding instance
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'trusted_certs' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updated VIF entry in instance network info cache for port 9b7b490f-5f0c-4df2-b016-5f494f3b0b3a. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updating instance_info_cache with network_info: [{"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a6d50f0-1c30-4076-85e0-d5417e2e9bdc req-50809ca0-5aeb-4df2-a4c9-c6f4c55ea631 service nova] Releasing lock "refresh_cache-330c761e-bda2-45ac-8731-fe511b40624c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'pci_requests' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'pci_devices' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'resources' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'migration_context' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72405) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquired lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: INFO nova.network.neutron [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Port 5db510f5-38c3-4a81-934b-e1ab20e1db31 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [{"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Releasing lock "refresh_cache-29c4e0e6-85dc-4db6-a801-2ff6a19115db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-2b57f253-ccde-4878-8d8f-c8344c2dac47 req-77a3fba3-b001-492d-927b-222362ea3a01 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-deleted-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e008d8f8-7a5d-43f1-ba9b-ff4f01bbcebd tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "interface-29c4e0e6-85dc-4db6-a801-2ff6a19115db-5db510f5-38c3-4a81-934b-e1ab20e1db31" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.017s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance destroyed successfully.
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance destroyed successfully.
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1614868477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-674469148',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2/Tv+b0uztkXHMREr0UP8T0i6R/8JrjK1hb5/JEax3JDtvpPQmo4hkEAoigmfGRTl79Pw59QXqqVHqBZYXTbZQ9o/acWpERhf3mjn3D88m8ZJHZVoYA1j9Wo3IojtHjw==',key_name='tempest-keypair-861392922',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21f0a5ebefd74f72810befd87bf0555e',ramdisk_id='',reservation_id='r-wzbbfqxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1828337581',owner_user_name='tempest-ServerActionsV293TestJSON-1828337581-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0bf5d8840da4cf6b94c2b86218e56b2',uuid=330c761e-bda2-45ac-8731-fe511b40624c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converting VIF {"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b7b490f-5f, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:31 user nova-compute[72405]: INFO os_vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f')
Aug 08 23:25:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:31 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a102b7-2855-4883-8e9a-eeb88636eba0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c50bfc-79c3-4556-b9dc-425788f299ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:31 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9815cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b574c7-91db-4d62-8416-84a3767466e4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[48292daa-1a1e-4bd5-a452-d9e4c0082e5a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c39861-9cd1-4af1-8993-3738876e4587]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98f7bac-5b1d-46e2-8d3d-22ceea6bff24]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de5437-88cc-46f7-985e-d74b0c982d7f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[250706a6-cc20-440d-8b24-1eb10cabd8ff]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]
Aug 08 23:25:32 user nova-compute[72405]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:32 user nova-compute[72405]: WARNING nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-plugged-5db510f5-38c3-4a81-934b-e1ab20e1db31 for instance with vm_state active and task_state None.
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-unplugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-unplugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:32 user nova-compute[72405]: WARNING nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-unplugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state active and task_state rebuilding.
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:32 user nova-compute[72405]: WARNING nova.compute.manager [req-e11307d1-025a-46b5-bdd9-1c267cfcf47e req-137e46c0-e098-4b4b-bcf9-397446e82d7f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state active and task_state rebuilding.
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[74307e04-9729-40bf-8e88-77a9292ff5ca]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== disconnect_volume: return (435ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Deleting instance files /opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c_del
Aug 08 23:25:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Deletion of /opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c_del complete
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:25:32 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:25:32 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7147MB free_disk=25.58977508544922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:32 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 330c761e-bda2-45ac-8731-fe511b40624c could not be found.
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:32 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb9af7-fbef-492b-8096-87cd23047b7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 760574b8-2c65-4bb3-9ea6-1462bd32774b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 330c761e-bda2-45ac-8731-fe511b40624c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:25:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5adae7-78a5-4e5f-8768-8bc9b4748acb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:33 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:33 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9815e710>, {}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Disconnecting from: [] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== disconnect_volume: return (63ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvqRXYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '760574b8-2c65-4bb3-9ea6-1462bd32774b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5aed676-1610-4849-beda-1e67de74a8ea', 'serial': 'b5aed676-1610-4849-beda-1e67de74a8ea'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '760574b8-2c65-4bb3-9ea6-1462bd32774b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd24ae3c-7fa6-4fbc-9094-59a4041f27b8', 'serial'} {{(pid=72405) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvqRXYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:38 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:38 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:38 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f11c640-4caf-40fd-9d54-b6a6cd43dfe5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:38 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae80f2f-3508-4136-ae97-ff1b2bf9887b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea] added
Aug 08 23:25:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc6aca2-beaa-4d6d-a88e-1ab3b5a915ed]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f12120-01d3-4bdb-b1c4-a8391953f5ae]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGvqRXYz {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGvqRXYz" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb2d69-54a4-45cd-9798-9791d50608b7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SGvqRXYz'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b5a85-5761-42de-9652-a6d69ca3e52d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c03549-ac52-4208-b5f2-ad02aefe420a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b264405-7418-4862-ae39-919dd3eff47d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260]
Aug 08 23:25:38 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31f78e-badd-4189-94fa-4db957c8cc3e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f12b5e-8c95-4aee-9ecf-3e45f6d8178e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:38 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Preparing to wait for external event volume-reimaged-71eafcd6-2945-46a2-b22c-7e20d018c7a5 {{(pid=72405) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21528030-ca88-4b44-9015-7cecb83cd6b1]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvqRXYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:25:39 user nova-compute[72405]: INFO nova.compute.claims [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Claim successful on node user
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26366383930636433', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366383930636433', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lazy-loading 'flavor' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:25:39 user nova-compute[72405]: INFO nova.virt.block_device [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Booting with blank volume at /dev/vda
Aug 08 23:25:39 user nova-compute[72405]: DEBUG nova.policy [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9b5279220af4cc4a364014419168ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf26de781ef4462914d7f32168b3192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:25:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Successfully created port: b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:25:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 395313152 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Successfully updated port: b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.compute.manager [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-changed-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.compute.manager [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Refreshing instance network info cache due to event network-changed-b92a56a7-a14c-479f-852d-f8308c418daf. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] Acquiring lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 534773760 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance network_info: |[{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] Acquired lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.network.neutron [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Refreshing network info cache for port b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 704643072 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updated VIF entry in instance network info cache for port b92a56a7-a14c-479f-852d-f8308c418daf. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e3291b3a-74a9-4945-b9f4-d93367523957 req-73a0f99f-ac6d-4691-b751-f34d5919ec98 service nova] Releasing lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 994050048 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:44 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5237b29-ad2d-482b-85a7-f2a2e57ae0ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e1945-99d2-451c-827d-e134215f9661]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:44 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:44 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7be2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'): ({'sdj'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Removing single pathed devices sdj {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eedf6e-1978-4e47-b245-60986fd9487a]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9beb5b-4889-4c55-b136-6ec262dede51]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Flushing IO for device /dev/sdj {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d0e0c-3de1-4018-8929-9359525b74ed]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.067s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9cb812-3d13-40b7-b095-d435be6f06c5]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] SCSI volumes sdj have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e54f907-6e77-416d-a0d6-51382f7ac233]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c3957-ce11-4576-be94-247a0d320065]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]
Aug 08 23:25:44 user nova-compute[72405]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:44 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8855044-abd1-44cd-815e-48daddced7be]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] <== disconnect_volume: return (338ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvqRXYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '760574b8-2c65-4bb3-9ea6-1462bd32774b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5aed676-1610-4849-beda-1e67de74a8ea', 'serial'} {{(pid=72405) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 08 23:25:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] swap_volume: removing Cinder connection for volume fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 {{(pid=72405) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG os_brick.utils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada3e1b-5152-4390-b205-850c4798a122]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f59d6-d402-4a50-b3af-c6d70f758842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b98516-e885-49bf-9bb6-89378a02329a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49581a-8dcf-495b-8aaf-f79fc1389786]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:45 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce74eff-1a25-4a6c-839c-8e5840299ba8]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG os_brick.utils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating existing volume attachment record: ea67322b-d63c-44fe-9ce4-f7ec402cd669 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] swap_volume: Updating volume fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "SGvqRXYz", "auth_password": "kvZ0Y1ElDC8yNa", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "b5aed676-1610-4849-beda-1e67de74a8ea"}, "status": "reserved", "instance": "760574b8-2c65-4bb3-9ea6-1462bd32774b", "attached_at": "", "detached_at": "", "volume_id": "b5aed676-1610-4849-beda-1e67de74a8ea", "serial": "b5aed676-1610-4849-beda-1e67de74a8ea"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b5aed676-1610-4849-beda-1e67de74a8ea', 'no_device': None, 'attachment_id': '961deb31-d40b-417d-bacf-71ec13248968'} {{(pid=72405) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 08 23:25:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4226a81-7ef2-4e0e-a04a-505331a257f4 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.643s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537131.660546, 330c761e-bda2-45ac-8731-fe511b40624c => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:25:46 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] VM Stopped (Lifecycle Event)
Aug 08 23:25:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d51438c9-f5ab-435d-988f-b6b1cbb8cb74 None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG os_brick.utils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f1ef7-b31a-4b47-b1a0-6cbfb15ff891]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f79e44-c74b-4c94-8f5f-bf362e66dcf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54da009-ba23-4d5f-9c53-e53f8bd8420c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d42aea-a99d-4dfc-aeed-14ea8e232fc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:25:46 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:25:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[20976220-149e-46ee-9049-06bb10d7dfe6]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:25:46 user nova-compute[72405]: DEBUG os_brick.utils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:47 user nova-compute[72405]: INFO nova.compute.manager [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Swapping volume b5aed676-1610-4849-beda-1e67de74a8ea for fd24ae3c-7fa6-4fbc-9094-59a4041f27b8
Aug 08 23:25:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-changed-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing instance network info cache due to event network-changed-94100f59-cac9-428d-8e61-74b20c90d6f3. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:25:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] Acquiring lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:25:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] Acquired lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:25:52 user nova-compute[72405]: DEBUG nova.network.neutron [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Refreshing network info cache for port 94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:25:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:53 user nova-compute[72405]: DEBUG nova.network.neutron [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updated VIF entry in instance network info cache for port 94100f59-cac9-428d-8e61-74b20c90d6f3. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:25:53 user nova-compute[72405]: DEBUG nova.network.neutron [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:25:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-35b7058c-1d4e-4bdc-9d74-329fdd1624ff req-8a5a65f9-0e95-49e3-8019-dfdff889337e service nova] Releasing lock "refresh_cache-c3d07e7d-a00e-4a8b-81e3-902cf007cde2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:55 user nova-compute[72405]: INFO nova.compute.manager [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Terminating instance
Aug 08 23:25:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a0a38cb-c463-40c5-8dac-80da9e827c61 req-438d3cf0-e91b-487b-a121-f91726b0d08d service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a0a38cb-c463-40c5-8dac-80da9e827c61 req-438d3cf0-e91b-487b-a121-f91726b0d08d service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a0a38cb-c463-40c5-8dac-80da9e827c61 req-438d3cf0-e91b-487b-a121-f91726b0d08d service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a0a38cb-c463-40c5-8dac-80da9e827c61 req-438d3cf0-e91b-487b-a121-f91726b0d08d service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a0a38cb-c463-40c5-8dac-80da9e827c61 req-438d3cf0-e91b-487b-a121-f91726b0d08d service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a0a38cb-c463-40c5-8dac-80da9e827c61 req-438d3cf0-e91b-487b-a121-f91726b0d08d service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-7782ca35-8361-436f-a2e4-76f0a66bb15a for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-6e11c84b-d511-4d2e-b298-dd56d698cf19 req-80fb5abc-da82-4084-91fa-081ebf580a36 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6e11c84b-d511-4d2e-b298-dd56d698cf19 req-80fb5abc-da82-4084-91fa-081ebf580a36 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6e11c84b-d511-4d2e-b298-dd56d698cf19 req-80fb5abc-da82-4084-91fa-081ebf580a36 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6e11c84b-d511-4d2e-b298-dd56d698cf19 req-80fb5abc-da82-4084-91fa-081ebf580a36 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-6e11c84b-d511-4d2e-b298-dd56d698cf19 req-80fb5abc-da82-4084-91fa-081ebf580a36 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-6e11c84b-d511-4d2e-b298-dd56d698cf19 req-80fb5abc-da82-4084-91fa-081ebf580a36 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-94100f59-cac9-428d-8e61-74b20c90d6f3 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9fbc553b-13a9-4bf8-ad98-e91d3600d8f5 req-19ad79a6-2fbf-4a91-9bf4-e26e9b738a16 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9fbc553b-13a9-4bf8-ad98-e91d3600d8f5 req-19ad79a6-2fbf-4a91-9bf4-e26e9b738a16 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9fbc553b-13a9-4bf8-ad98-e91d3600d8f5 req-19ad79a6-2fbf-4a91-9bf4-e26e9b738a16 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9fbc553b-13a9-4bf8-ad98-e91d3600d8f5 req-19ad79a6-2fbf-4a91-9bf4-e26e9b738a16 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9fbc553b-13a9-4bf8-ad98-e91d3600d8f5 req-19ad79a6-2fbf-4a91-9bf4-e26e9b738a16 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-9fbc553b-13a9-4bf8-ad98-e91d3600d8f5 req-19ad79a6-2fbf-4a91-9bf4-e26e9b738a16 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '760574b8-2c65-4bb3-9ea6-1462bd32774b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd24ae3c-7fa6-4fbc-9094-59a4041f27b8', 'serial': 'fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvqRXYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'b5aed676-1610-4849-beda-1e67de74a8ea'}, 'status': 'reserved', 'instance': '760574b8-2c65-4bb3-9ea6-1462bd32774b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5aed676-1610-4849-beda-1e67de74a8ea', 'serial'} {{(pid=72405) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b24920-0633-4bea-8b28-f5450c1e020f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:25:57 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8c4a5-866e-4d0a-bf37-afe6310bfbcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8] added
Aug 08 23:25:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Instance destroyed successfully.
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lazy-loading 'resources' on Instance uuid c3d07e7d-a00e-4a8b-81e3-902cf007cde2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1126ebb2-a7b5-4da3-86cc-cd47f86f11c9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94100f59-ca, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a592423-1430-4969-a986-19074997b6fe]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNVGaPut {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNVGaPut" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff571eb-672a-4620-9da5-cbc6d2905b74]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNVGaPut'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:cb:57,bridge_name='br-int',has_traffic_filtering=True,id=94100f59-cac9-428d-8e61-74b20c90d6f3,network=Network(72844636-6705-465e-aff1-611f4975720f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94100f59-ca')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7782ca35-83, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[43913511-6eb0-4fa4-960a-378d30f82d54]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e535472-0170-43d9-97b8-7c29056da849]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:40:83,bridge_name='br-int',has_traffic_filtering=True,id=7782ca35-8361-436f-a2e4-76f0a66bb15a,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7782ca35-83')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0af855a-88, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:01:e4,bridge_name='br-int',has_traffic_filtering=True,id=e0af855a-8881-4ce7-99f5-40df76bd1c80,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0af855a-88')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "address": "fa:16:3e:ff:3c:38", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffbae4e-e1", "ovs_interfaceid": "9ffbae4e-e1a9-46eb-9e94-d7221788880f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ffbae4e-e1, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca25c8a-8c08-4402-9d16-1bff74040bbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]
Aug 08 23:25:57 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:3c:38,bridge_name='br-int',has_traffic_filtering=True,id=9ffbae4e-e1a9-46eb-9e94-d7221788880f,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffbae4e-e1')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80db08a8-26, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc9006-a1af-40de-b281-69fee4609194]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=80db08a8-2674-4568-a637-0edc4d110763,network=Network(18ecdaa5-8851-4714-89ef-77294d7edf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80db08a8-26')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb9b413-72, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b20a2ba-ae40-4189-9119-02a76806a1a5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:57 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.475s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] HCTL ('40', '-', '-', 0) found on session 16 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e2:f1,bridge_name='br-int',has_traffic_filtering=True,id=6eb9b413-72dc-4187-8470-126b1106e523,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb9b413-72')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1313177768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1313177768',id=12,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZCJ8qxynDcV5zAW/cdoWARpIMEYyCUejtfZM/kOQGkPndPx56UcOcVyoe9+u1sQBUturlMKhq5S4E5R4c4/sRDque0ID4JairdsnK+H+23602+bHAE8pxcll/eFNFww==',key_name='tempest-keypair-1417793076',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c6177572d644cfa81eee95c9b6cb5b',ramdisk_id='',reservation_id='r-e37e6vb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1825716698',owner_user_name='tempest-TaggedBootDevicesTest-1825716698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a4c9aa56b44b3fa831e7d6ab99ff5e',uuid=c3d07e7d-a00e-4a8b-81e3-902cf007cde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converting VIF {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ded0468-3c, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:57 user nova-compute[72405]: INFO os_vif [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:f0:ad,bridge_name='br-int',has_traffic_filtering=True,id=8ded0468-3c34-48c4-b84b-af969b3ba3ca,network=Network(d65defd6-674c-42b6-984e-8f453b3b364c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ded0468-3c')
Aug 08 23:25:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KstjgwuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.084s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b9e9a-49b8-4a96-8f22-62532bf64662]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Searching for a device in session 16 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:25:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-7782ca35-8361-436f-a2e4-76f0a66bb15a for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-6eb9b413-72dc-4187-8470-126b1106e523 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-6b67c8ee-6eb6-4363-8812-26c5170ccaaa req-f1386ab8-8e8b-48a2-b7e1-da9075bbc4f9 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-6eb9b413-72dc-4187-8470-126b1106e523 for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-9ffbae4e-e1a9-46eb-9e94-d7221788880f for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-80db08a8-2674-4568-a637-0edc4d110763 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-80db08a8-2674-4568-a637-0edc4d110763 for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-e02f7ec1-8927-4da3-b94b-6ec398d5cd5a req-a4a43df6-b0e4-4325-8063-e1fbad1aa350 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-8ded0468-3c34-48c4-b84b-af969b3ba3ca for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-94100f59-cac9-428d-8e61-74b20c90d6f3 for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-unplugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-unplugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Acquiring lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] No waiting events found dispatching network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:25:58 user nova-compute[72405]: WARNING nova.compute.manager [req-9c4e318d-2f25-49ac-ab1c-2a2aa9c1995b req-fe7c42b4-f9d2-482a-ac0e-2e639f15b0ff service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received unexpected event network-vif-plugged-e0af855a-8881-4ce7-99f5-40df76bd1c80 for instance with vm_state active and task_state deleting.
Aug 08 23:25:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.581s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] <== connect_volume: return (1582ms) {'type': 'block', 'scsi_wwn': '23565363936336537', 'path': '/dev/sdi'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565363936336537', 'path': '/dev/sdi'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.055s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lazy-loading 'flavor' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2efb6a3-4cea-4578-8fee-2e762cf1c6db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac08511-9683-4eb9-ac0d-9640e815a100]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:58 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9808f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84576dd-e7af-49ed-a99a-3f01b44d18d1]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b4c4ef-7d88-4d19-b2bc-438d8d381763]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e70420-34f4-48d9-82ff-92d24d163583]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f2c2c1-da09-45f4-9a59-5d481070db4b]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe5585-f4ec-4070-8f5b-9413d8aecbc1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a7233-4534-4391-8cb7-aeca6b4e9198]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260]
Aug 08 23:25:59 user nova-compute[72405]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a392004b-3893-4731-9eb1-a22dc1d73ad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca93e8-d62b-4562-b5c7-6aee7011885b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== disconnect_volume: return (1386ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FczXatSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:59 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e42d88-4191-489c-b8ce-e88542582d90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[860bddea-96e0-47c5-8c07-bcadc5135e36]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba5514310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c293c77-e445-4326-9c0a-5b63ddc3fb9a]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f81036-3c0a-4903-b374-7c142eff6b87]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd02ee60-fbc5-48de-a17d-5f136f3982fc]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e6ca9-58b6-47fd-a4ec-8bc0e358a98f]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ccc246-5442-4c01-b950-b45822c388c5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b2c08c-b816-455a-93a6-9af9cca940c7]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260]
Aug 08 23:25:59 user nova-compute[72405]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5cd9d97-07d2-41ab-a2ed-b47d1c3ecd20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2658e450-64d6-42bc-9e37-b173694fc8a8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== disconnect_volume: return (393ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajTnglEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:25:59 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b91ee-35a4-486f-b907-dff71fd443a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f0a0e2-2879-4569-9308-d7377fead246]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:25:59 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7be3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8120a8f-2dfc-4731-be87-7b9b6aa11628]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44089ec5-88a5-4601-a906-b183b787cad2]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c9c8b-bd33-4ae7-9629-cb0776d47dce]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab2681-f91d-4886-9ef0-572369432b32]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 105906176 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5300ae-a9ee-4a11-8dc3-af8d10b4b6ee]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0afb55-52e7-4c4b-bf71-493267cc99d8]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260]
Aug 08 23:25:59 user nova-compute[72405]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95, portal: 172.16.0.220,3260] successful.
Aug 08 23:25:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9ace62-0227-4746-af80-87313f305f95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.058s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9096c999-0585-4425-b540-757b1a622e5c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] <== disconnect_volume: return (403ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:25:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:25:59 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Deleting instance files /opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2_del
Aug 08 23:25:59 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Deletion of /opt/stack/data/nova/instances/c3d07e7d-a00e-4a8b-81e3-902cf007cde2_del complete
Aug 08 23:26:00 user nova-compute[72405]: INFO nova.compute.manager [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Took 4.65 seconds to destroy the instance on the hypervisor.
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 222298112 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:26:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Creating image(s)
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Ensure instance console log exists: /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Start _get_guest_xml network_info=[{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea67322b-d63c-44fe-9ce4-f7ec402cd669', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2adde477-61ea-4f06-a71d-86a3d94902f2', 'attached_at': '', 'detached_at': '', 'volume_id': '22783579-94d2-4c13-b34a-b324335d69d2', 'serial': '22783579-94d2-4c13-b34a-b324335d69d2'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:26:00 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:00 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:00 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:00 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:00 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 339738624 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de433e9-eac7-45e0-99ff-1fc7eee6293e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:26:00 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ad2f8-12ac-4a36-ad4f-0ab14366f548]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2] added
Aug 08 23:26:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be6e41d-a021-4df7-93f0-df1cf7645fed]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38f243-e333-4386-9bd0-56e53f7c623e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAxJkVXU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAxJkVXU" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4305d494-270c-4490-8be8-79e17cfc7216]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GAxJkVXU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32553e3-44e7-4b7d-a6e0-4b8883a05cbb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ed8b5-6265-4842-a165-6dd92c67af07]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:26:00 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:00 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:00 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:26:00 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:00 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:00 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[614dd382-69f0-4270-b6af-0cf3f1458e13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260]
Aug 08 23:26:01 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260] successful.
Aug 08 23:26:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9343a9e0-092b-412f-a43c-cfe0f70eae7d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ad199-7616-471f-8c5f-459a89eb16c7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:01 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e329f3-033c-4bda-b2d4-be78439911f2]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 493879296 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 636485632 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 req-8d40c203-5641-4bfb-b018-f2fdafd3149f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event volume-reimaged-71eafcd6-2945-46a2-b22c-7e20d018c7a5 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 req-8d40c203-5641-4bfb-b018-f2fdafd3149f service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 req-8d40c203-5641-4bfb-b018-f2fdafd3149f service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 req-8d40c203-5641-4bfb-b018-f2fdafd3149f service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 req-8d40c203-5641-4bfb-b018-f2fdafd3149f service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Processing event volume-reimaged-71eafcd6-2945-46a2-b22c-7e20d018c7a5 {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:26:02 user nova-compute[72405]: INFO nova.virt.block_device [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Booting with volume 71eafcd6-2945-46a2-b22c-7e20d018c7a5 at /dev/vda
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23663653964376135', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663653964376135', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743707640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743707640',id=14,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-qbho4jw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:25:40Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=2adde477-61ea-4f06-a71d-86a3d94902f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'pci_devices' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.utils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:26:02 user nova-compute[72405]:   <uuid>2adde477-61ea-4f06-a71d-86a3d94902f2</uuid>
Aug 08 23:26:02 user nova-compute[72405]:   <name>instance-0000000e</name>
Aug 08 23:26:02 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:26:02 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:26:02 user nova-compute[72405]:   <metadata>
Aug 08 23:26:02 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:26:02 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:26:02 user nova-compute[72405]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1743707640</nova:name>
Aug 08 23:26:02 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:26:00</nova:creationTime>
Aug 08 23:26:02 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:26:02 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:26:02 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:26:02 user nova-compute[72405]:       <nova:owner>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:user uuid="d9b5279220af4cc4a364014419168ae8">tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member</nova:user>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:project uuid="1bf26de781ef4462914d7f32168b3192">tempest-ServerBootFromVolumeStableRescueTest-1549652719</nova:project>
Aug 08 23:26:02 user nova-compute[72405]:       </nova:owner>
Aug 08 23:26:02 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:26:02 user nova-compute[72405]:       <nova:ports>
Aug 08 23:26:02 user nova-compute[72405]:         <nova:port uuid="b92a56a7-a14c-479f-852d-f8308c418daf">
Aug 08 23:26:02 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 08 23:26:02 user nova-compute[72405]:         </nova:port>
Aug 08 23:26:02 user nova-compute[72405]:       </nova:ports>
Aug 08 23:26:02 user nova-compute[72405]:     </nova:instance>
Aug 08 23:26:02 user nova-compute[72405]:   </metadata>
Aug 08 23:26:02 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:26:02 user nova-compute[72405]:     <system>
Aug 08 23:26:02 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:26:02 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:26:02 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:26:02 user nova-compute[72405]:       <entry name="serial">2adde477-61ea-4f06-a71d-86a3d94902f2</entry>
Aug 08 23:26:02 user nova-compute[72405]:       <entry name="uuid">2adde477-61ea-4f06-a71d-86a3d94902f2</entry>
Aug 08 23:26:02 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:26:02 user nova-compute[72405]:     </system>
Aug 08 23:26:02 user nova-compute[72405]:   </sysinfo>
Aug 08 23:26:02 user nova-compute[72405]:   <os>
Aug 08 23:26:02 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:26:02 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:26:02 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:26:02 user nova-compute[72405]:   </os>
Aug 08 23:26:02 user nova-compute[72405]:   <features>
Aug 08 23:26:02 user nova-compute[72405]:     <acpi/>
Aug 08 23:26:02 user nova-compute[72405]:     <apic/>
Aug 08 23:26:02 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:26:02 user nova-compute[72405]:   </features>
Aug 08 23:26:02 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:26:02 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:26:02 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:26:02 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:26:02 user nova-compute[72405]:   </clock>
Aug 08 23:26:02 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:26:02 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:26:02 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:26:02 user nova-compute[72405]:   </cpu>
Aug 08 23:26:02 user nova-compute[72405]:   <devices>
Aug 08 23:26:02 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:26:02 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:26:02 user nova-compute[72405]:       <source dev="/dev/sdc"/>
Aug 08 23:26:02 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:26:02 user nova-compute[72405]:       <serial>22783579-94d2-4c13-b34a-b324335d69d2</serial>
Aug 08 23:26:02 user nova-compute[72405]:     </disk>
Aug 08 23:26:02 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:26:02 user nova-compute[72405]:       <mac address="fa:16:3e:52:c2:72"/>
Aug 08 23:26:02 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:02 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:26:02 user nova-compute[72405]:       <target dev="tapb92a56a7-a1"/>
Aug 08 23:26:02 user nova-compute[72405]:     </interface>
Aug 08 23:26:02 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:26:02 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/console.log" append="off"/>
Aug 08 23:26:02 user nova-compute[72405]:     </serial>
Aug 08 23:26:02 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:26:02 user nova-compute[72405]:     <video>
Aug 08 23:26:02 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:02 user nova-compute[72405]:     </video>
Aug 08 23:26:02 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:26:02 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:26:02 user nova-compute[72405]:     </rng>
Aug 08 23:26:02 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:26:02 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:26:02 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:26:02 user nova-compute[72405]:     </memballoon>
Aug 08 23:26:02 user nova-compute[72405]:   </devices>
Aug 08 23:26:02 user nova-compute[72405]: </domain>
Aug 08 23:26:02 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743707640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743707640',id=14,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-qbho4jw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:25:40Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=2adde477-61ea-4f06-a71d-86a3d94902f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_vif [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb92a56a7-a1, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb92a56a7-a1, col_values=(('external_ids', {'iface-id': 'b92a56a7-a14c-479f-852d-f8308c418daf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:c2:72', 'vm-uuid': '2adde477-61ea-4f06-a71d-86a3d94902f2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f2ffac-efad-4e5c-b11a-9f8037e489b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:02 user nova-compute[72405]: INFO os_vif [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1')
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 808452096 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3227c1-612b-4755-9aca-d046f03782b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8969a404-9952-440d-97cc-2a7fa95b95a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e21a06-da55-43c3-bfbe-574abf6b67b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:26:02 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:26:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e889a-9d6b-465c-ad1f-ca8d63eb4d26]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG os_brick.utils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updating existing volume attachment record: a9b36cd0-9c51-4f47-bc31-109876904f61 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No VIF found with MAC fa:16:3e:52:c2:72, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 962592768 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-92d4c25c-2a3f-4c58-af71-f52daa0c6bbe req-a5b7793f-c7ba-4f63-a20c-325791554032 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-deleted-9ffbae4e-e1a9-46eb-9e94-d7221788880f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:02 user nova-compute[72405]: INFO nova.compute.manager [req-92d4c25c-2a3f-4c58-af71-f52daa0c6bbe req-a5b7793f-c7ba-4f63-a20c-325791554032 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Neutron deleted interface 9ffbae4e-e1a9-46eb-9e94-d7221788880f; detaching it from the instance and deleting it from the info cache
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.network.neutron [req-92d4c25c-2a3f-4c58-af71-f52daa0c6bbe req-a5b7793f-c7ba-4f63-a20c-325791554032 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80db08a8-2674-4568-a637-0edc4d110763", "address": "fa:16:3e:75:06:e7", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80db08a8-26", "ovs_interfaceid": "80db08a8-2674-4568-a637-0edc4d110763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-92d4c25c-2a3f-4c58-af71-f52daa0c6bbe req-a5b7793f-c7ba-4f63-a20c-325791554032 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Detach interface failed, port_id=9ffbae4e-e1a9-46eb-9e94-d7221788880f, reason: Instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:26:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 1072693248 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:26:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd013299-a563-4b27-bac1-9b2f40888fe5 req-4c10de47-4ab1-4f42-857d-6e1e766e1f5d service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd013299-a563-4b27-bac1-9b2f40888fe5 req-4c10de47-4ab1-4f42-857d-6e1e766e1f5d service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd013299-a563-4b27-bac1-9b2f40888fe5 req-4c10de47-4ab1-4f42-857d-6e1e766e1f5d service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd013299-a563-4b27-bac1-9b2f40888fe5 req-4c10de47-4ab1-4f42-857d-6e1e766e1f5d service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd013299-a563-4b27-bac1-9b2f40888fe5 req-4c10de47-4ab1-4f42-857d-6e1e766e1f5d service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:04 user nova-compute[72405]: WARNING nova.compute.manager [req-bd013299-a563-4b27-bac1-9b2f40888fe5 req-4c10de47-4ab1-4f42-857d-6e1e766e1f5d service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state building and task_state spawning.
Aug 08 23:26:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvqRXYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'b5aed676-1610-4849-beda-1e67de74a8ea'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:04 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf05875c-4b0a-401f-8d82-087c220d1c06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc617c2-6b47-4ccf-b2fb-730e76ef05d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:04 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:04 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:04 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781996c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c47ea-e43e-45dd-a051-a1cd1a758890]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aa5548-ee5b-48db-ae25-c952660c8417]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ec1934-6643-418b-91e8-bec2985055d4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f6c16e-eaf8-40ac-9525-346dc72a18ed]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6e203a-fc60-4b4b-819c-ad2841f17eb9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab2fae-6f84-4053-8db5-806a1e2ed13f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260]
Aug 08 23:26:04 user nova-compute[72405]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea, portal: 172.16.0.220,3260] successful.
Aug 08 23:26:04 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5aed676-1610-4849-beda-1e67de74a8ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4ec24-cb4f-4099-90c5-604460d6f311]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] <== disconnect_volume: return (361ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '760574b8-2c65-4bb3-9ea6-1462bd32774b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd24ae3c-7fa6-4fbc-9094-59a4041f27b8', 'serial'} {{(pid=72405) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] swap_volume: removing Cinder connection for volume b5aed676-1610-4849-beda-1e67de74a8ea {{(pid=72405) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-deleted-80db08a8-2674-4568-a637-0edc4d110763 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:04 user nova-compute[72405]: INFO nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Neutron deleted interface 80db08a8-2674-4568-a637-0edc4d110763; detaching it from the instance and deleting it from the info cache
Aug 08 23:26:04 user nova-compute[72405]: DEBUG nova.network.neutron [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6eb9b413-72dc-4187-8470-126b1106e523", "address": "fa:16:3e:78:e2:f1", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb9b413-72", "ovs_interfaceid": "6eb9b413-72dc-4187-8470-126b1106e523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Detach interface failed, port_id=80db08a8-2674-4568-a637-0edc4d110763, reason: Instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-deleted-6eb9b413-72dc-4187-8470-126b1106e523 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:05 user nova-compute[72405]: INFO nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Neutron deleted interface 6eb9b413-72dc-4187-8470-126b1106e523; detaching it from the instance and deleting it from the info cache
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "address": "fa:16:3e:4b:f0:ad", "network": {"id": "d65defd6-674c-42b6-984e-8f453b3b364c", "bridge": "br-int", "label": "tempest-device-tagging-net2-2027173648", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ded0468-3c", "ovs_interfaceid": "8ded0468-3c34-48c4-b84b-af969b3ba3ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Detach interface failed, port_id=6eb9b413-72dc-4187-8470-126b1106e523, reason: Instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-deleted-8ded0468-3c34-48c4-b84b-af969b3ba3ca {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:05 user nova-compute[72405]: INFO nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Neutron deleted interface 8ded0468-3c34-48c4-b84b-af969b3ba3ca; detaching it from the instance and deleting it from the info cache
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [{"id": "94100f59-cac9-428d-8e61-74b20c90d6f3", "address": "fa:16:3e:01:cb:57", "network": {"id": "72844636-6705-465e-aff1-611f4975720f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1329229187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94100f59-ca", "ovs_interfaceid": "94100f59-cac9-428d-8e61-74b20c90d6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "address": "fa:16:3e:ae:40:83", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782ca35-83", "ovs_interfaceid": "7782ca35-8361-436f-a2e4-76f0a66bb15a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "address": "fa:16:3e:e5:01:e4", "network": {"id": "18ecdaa5-8851-4714-89ef-77294d7edf60", "bridge": "br-int", "label": "tempest-device-tagging-net1-81224112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66c6177572d644cfa81eee95c9b6cb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0af855a-88", "ovs_interfaceid": "e0af855a-8881-4ce7-99f5-40df76bd1c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-7752d040-556a-491f-a384-3a2b9e1db901 req-d161530f-3a39-4950-9b6f-faa8c5126b05 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Detach interface failed, port_id=8ded0468-3c34-48c4-b84b-af969b3ba3ca, reason: Instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:26:05 user nova-compute[72405]: INFO nova.compute.claims [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Claim successful on node user
Aug 08 23:26:05 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:05 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Took 5.86 seconds to deallocate network for instance.
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-8fdb9789-1e62-4f90-a79b-f4102e83213e req-9bca81df-0663-4a14-acb8-58138b1432f2 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8fdb9789-1e62-4f90-a79b-f4102e83213e req-9bca81df-0663-4a14-acb8-58138b1432f2 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8fdb9789-1e62-4f90-a79b-f4102e83213e req-9bca81df-0663-4a14-acb8-58138b1432f2 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8fdb9789-1e62-4f90-a79b-f4102e83213e req-9bca81df-0663-4a14-acb8-58138b1432f2 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-8fdb9789-1e62-4f90-a79b-f4102e83213e req-9bca81df-0663-4a14-acb8-58138b1432f2 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:06 user nova-compute[72405]: WARNING nova.compute.manager [req-8fdb9789-1e62-4f90-a79b-f4102e83213e req-9bca81df-0663-4a14-acb8-58138b1432f2 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state building and task_state spawning.
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.policy [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d9d95793fbe40989729a80e72bde91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ac2c8f4474e83abe622858fe2fd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537166.5787106, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Resumed (Lifecycle Event)
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Creating image(s)
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "/opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "/opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "/opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance spawned successfully.
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537166.582408, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Started (Lifecycle Event)
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Took 6.16 seconds to spawn the instance on the hypervisor.
Aug 08 23:26:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:06 user nova-compute[72405]: INFO nova.compute.manager [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Took 27.55 seconds to build instance.
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6c8ed864-61f0-4ba8-8f04-2e095dab2e83 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.678s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk 1073741824" returned: 0 in 0.053s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.172s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-216ac406-8aac-4bbd-82a6-f6f6a6e594df req-41dd7a9d-1121-46ad-8816-8cae34d4d2d4 service nova] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Received event network-vif-deleted-94100f59-cac9-428d-8e61-74b20c90d6f3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Successfully created port: ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Cannot resize image /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'migration_context' on Instance uuid 51cd87b7-e26e-4bb0-9b07-8f22e3244935 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Ensure instance console log exists: /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Successfully updated port: ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:26:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "refresh_cache-51cd87b7-e26e-4bb0-9b07-8f22e3244935" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquired lock "refresh_cache-51cd87b7-e26e-4bb0-9b07-8f22e3244935" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Updating instance_info_cache with network_info: [{"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Releasing lock "refresh_cache-51cd87b7-e26e-4bb0-9b07-8f22e3244935" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Instance network_info: |[{"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Start _get_guest_xml network_info=[{"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:26:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833179845',display_name='tempest-VolumesAdminNegativeTest-server-1833179845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833179845',id=15,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c2ac2c8f4474e83abe622858fe2fd1d',ramdisk_id='',reservation_id='r-r6rn5lwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1763761892',owner_user_name='tempest-VolumesAdminNegativeTest-1763761892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:07Z,user_data=None,user_id='5d9d95793fbe40989729a80e72bde91d',uuid=51cd87b7-e26e-4bb0-9b07-8f22e3244935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converting VIF {"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'pci_devices' on Instance uuid 51cd87b7-e26e-4bb0-9b07-8f22e3244935 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:26:08 user nova-compute[72405]:   <uuid>51cd87b7-e26e-4bb0-9b07-8f22e3244935</uuid>
Aug 08 23:26:08 user nova-compute[72405]:   <name>instance-0000000f</name>
Aug 08 23:26:08 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:26:08 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:26:08 user nova-compute[72405]:   <metadata>
Aug 08 23:26:08 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:26:08 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:26:08 user nova-compute[72405]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1833179845</nova:name>
Aug 08 23:26:08 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:26:08</nova:creationTime>
Aug 08 23:26:08 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:26:08 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:26:08 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:26:08 user nova-compute[72405]:       <nova:owner>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:user uuid="5d9d95793fbe40989729a80e72bde91d">tempest-VolumesAdminNegativeTest-1763761892-project-member</nova:user>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:project uuid="0c2ac2c8f4474e83abe622858fe2fd1d">tempest-VolumesAdminNegativeTest-1763761892</nova:project>
Aug 08 23:26:08 user nova-compute[72405]:       </nova:owner>
Aug 08 23:26:08 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:26:08 user nova-compute[72405]:       <nova:ports>
Aug 08 23:26:08 user nova-compute[72405]:         <nova:port uuid="ffa1d28a-84fc-4b9a-af69-b2a3e38b781a">
Aug 08 23:26:08 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 08 23:26:08 user nova-compute[72405]:         </nova:port>
Aug 08 23:26:08 user nova-compute[72405]:       </nova:ports>
Aug 08 23:26:08 user nova-compute[72405]:     </nova:instance>
Aug 08 23:26:08 user nova-compute[72405]:   </metadata>
Aug 08 23:26:08 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:26:08 user nova-compute[72405]:     <system>
Aug 08 23:26:08 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:26:08 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:26:08 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:26:08 user nova-compute[72405]:       <entry name="serial">51cd87b7-e26e-4bb0-9b07-8f22e3244935</entry>
Aug 08 23:26:08 user nova-compute[72405]:       <entry name="uuid">51cd87b7-e26e-4bb0-9b07-8f22e3244935</entry>
Aug 08 23:26:08 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:26:08 user nova-compute[72405]:     </system>
Aug 08 23:26:08 user nova-compute[72405]:   </sysinfo>
Aug 08 23:26:08 user nova-compute[72405]:   <os>
Aug 08 23:26:08 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:26:08 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:26:08 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:26:08 user nova-compute[72405]:   </os>
Aug 08 23:26:08 user nova-compute[72405]:   <features>
Aug 08 23:26:08 user nova-compute[72405]:     <acpi/>
Aug 08 23:26:08 user nova-compute[72405]:     <apic/>
Aug 08 23:26:08 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:26:08 user nova-compute[72405]:   </features>
Aug 08 23:26:08 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:26:08 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:26:08 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:26:08 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:26:08 user nova-compute[72405]:   </clock>
Aug 08 23:26:08 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:26:08 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:26:08 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:26:08 user nova-compute[72405]:   </cpu>
Aug 08 23:26:08 user nova-compute[72405]:   <devices>
Aug 08 23:26:08 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:26:08 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:26:08 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk"/>
Aug 08 23:26:08 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:26:08 user nova-compute[72405]:     </disk>
Aug 08 23:26:08 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:26:08 user nova-compute[72405]:       <mac address="fa:16:3e:2f:97:3e"/>
Aug 08 23:26:08 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:08 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:26:08 user nova-compute[72405]:       <target dev="tapffa1d28a-84"/>
Aug 08 23:26:08 user nova-compute[72405]:     </interface>
Aug 08 23:26:08 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:26:08 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/console.log" append="off"/>
Aug 08 23:26:08 user nova-compute[72405]:     </serial>
Aug 08 23:26:08 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:26:08 user nova-compute[72405]:     <video>
Aug 08 23:26:08 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:08 user nova-compute[72405]:     </video>
Aug 08 23:26:08 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:26:08 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:26:08 user nova-compute[72405]:     </rng>
Aug 08 23:26:08 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:26:08 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:26:08 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:26:08 user nova-compute[72405]:     </memballoon>
Aug 08 23:26:08 user nova-compute[72405]:   </devices>
Aug 08 23:26:08 user nova-compute[72405]: </domain>
Aug 08 23:26:08 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833179845',display_name='tempest-VolumesAdminNegativeTest-server-1833179845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833179845',id=15,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c2ac2c8f4474e83abe622858fe2fd1d',ramdisk_id='',reservation_id='r-r6rn5lwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1763761892',owner_user_name='tempest-VolumesAdminNegativeTest-1763761892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:07Z,user_data=None,user_id='5d9d95793fbe40989729a80e72bde91d',uuid=51cd87b7-e26e-4bb0-9b07-8f22e3244935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converting VIF {"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG os_vif [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffa1d28a-84, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffa1d28a-84, col_values=(('external_ids', {'iface-id': 'ffa1d28a-84fc-4b9a-af69-b2a3e38b781a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:97:3e', 'vm-uuid': '51cd87b7-e26e-4bb0-9b07-8f22e3244935'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:08 user nova-compute[72405]: INFO os_vif [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84')
Aug 08 23:26:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] No VIF found with MAC fa:16:3e:2f:97:3e, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] swap_volume: Updating volume b5aed676-1610-4849-beda-1e67de74a8ea BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "hNVGaPut", "auth_password": "ey8AnuYBjKhx0z", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "fd24ae3c-7fa6-4fbc-9094-59a4041f27b8"}, "status": "reserved", "instance": "760574b8-2c65-4bb3-9ea6-1462bd32774b", "attached_at": "", "detached_at": "", "volume_id": "fd24ae3c-7fa6-4fbc-9094-59a4041f27b8", "serial": "fd24ae3c-7fa6-4fbc-9094-59a4041f27b8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'fd24ae3c-7fa6-4fbc-9094-59a4041f27b8', 'no_device': None, 'attachment_id': '6ac79631-9f72-4393-b171-eee23c658022'} {{(pid=72405) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-0e8c8bab-5425-4f13-9082-c1eec1506950 tempest-TestVolumeSwap-1909136459 tempest-TestVolumeSwap-1909136459-project-admin] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.776s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:08 user nova-compute[72405]: INFO nova.compute.manager [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Took 2.95 seconds to detach 3 volumes for instance.
Aug 08 23:26:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-changed-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Refreshing instance network info cache due to event network-changed-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] Acquiring lock "refresh_cache-51cd87b7-e26e-4bb0-9b07-8f22e3244935" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] Acquired lock "refresh_cache-51cd87b7-e26e-4bb0-9b07-8f22e3244935" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Refreshing network info cache for port ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:26:09 user nova-compute[72405]: INFO nova.compute.manager [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Detaching volume fd24ae3c-7fa6-4fbc-9094-59a4041f27b8
Aug 08 23:26:09 user nova-compute[72405]: INFO nova.virt.block_device [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Attempting to driver detach volume fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 from mountpoint /dev/vdb
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Attempting to detach device vdb from instance 760574b8-2c65-4bb3-9ea6-1462bd32774b from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:26:09 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:26:09 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:26:09 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:26:09 user nova-compute[72405]:   <serial>fd24ae3c-7fa6-4fbc-9094-59a4041f27b8</serial>
Aug 08 23:26:09 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:26:09 user nova-compute[72405]: </disk>
Aug 08 23:26:09 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:26:09 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Successfully detached device vdb from instance 760574b8-2c65-4bb3-9ea6-1462bd32774b from the persistent domain config.
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 760574b8-2c65-4bb3-9ea6-1462bd32774b from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:26:09 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:26:09 user nova-compute[72405]:   <source dev="/dev/sdi"/>
Aug 08 23:26:09 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:26:09 user nova-compute[72405]:   <serial>fd24ae3c-7fa6-4fbc-9094-59a4041f27b8</serial>
Aug 08 23:26:09 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:26:09 user nova-compute[72405]: </disk>
Aug 08 23:26:09 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:09 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Deleted allocations for instance c3d07e7d-a00e-4a8b-81e3-902cf007cde2
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c460b4c1-89ee-4ef0-a07c-978de89d78dc tempest-TaggedBootDevicesTest-1825716698 tempest-TaggedBootDevicesTest-1825716698-project-member] Lock "c3d07e7d-a00e-4a8b-81e3-902cf007cde2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.199s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Updated VIF entry in instance network info cache for port ffa1d28a-84fc-4b9a-af69-b2a3e38b781a. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Updating instance_info_cache with network_info: [{"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cdf08de1-99d5-48f5-b26c-5a2ce5737b30 req-343e1444-9bda-424f-b41b-fd489a7cd51d service nova] Releasing lock "refresh_cache-51cd87b7-e26e-4bb0-9b07-8f22e3244935" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537170.133962, 760574b8-2c65-4bb3-9ea6-1462bd32774b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:26:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Successfully detached device vdb from instance 760574b8-2c65-4bb3-9ea6-1462bd32774b from the live domain config.
Aug 08 23:26:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNVGaPut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:10 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[70850bdb-75e6-4007-a4cc-a078816ef601]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca40a696-494c-4176-b919-4ccb5b5dcf88]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:10 user nova-compute[72405]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:10 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:10 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 (non-flash)
Aug 08 23:26:10 user nova-compute[72405]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:10 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:10 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f1b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8'): ({'sdi'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Removing single pathed devices sdi {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd4bea-cb9e-469b-86fb-b93c4547aac5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e224c3e-29e4-4bb7-a2d9-fee715a0d29b]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Flushing IO for device /dev/sdi {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c1d189-607a-4be4-9242-8688724dacdc]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4bf37a-1278-434c-a886-9a5744608b88]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] SCSI volumes sdi have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb119ec-2eac-48a4-9d49-1a6f24eb92b9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3700404-3875-41e4-adca-94fd4ee90883]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260]
Aug 08 23:26:10 user nova-compute[72405]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8, portal: 172.16.0.220,3260] successful.
Aug 08 23:26:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd24ae3c-7fa6-4fbc-9094-59a4041f27b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950ae5f-82b3-4235-b808-fd65ba6d6a34]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] <== disconnect_volume: return (328ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] No waiting events found dispatching network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:11 user nova-compute[72405]: WARNING nova.compute.manager [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received unexpected event network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a for instance with vm_state building and task_state spawning.
Aug 08 23:26:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] No waiting events found dispatching network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:11 user nova-compute[72405]: WARNING nova.compute.manager [req-11344b7e-f3ac-4be4-b2e0-14eaa1a24ed4 req-d1771380-aa9a-4135-89b2-f2a778ea22a8 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received unexpected event network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a for instance with vm_state building and task_state spawning.
Aug 08 23:26:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lazy-loading 'flavor' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2eb175ec-56de-49ee-89d0-bb6ff488bf71 tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.208s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537157.2664888, c3d07e7d-a00e-4a8b-81e3-902cf007cde2 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] VM Stopped (Lifecycle Event)
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c3a689c3-bd67-4bdf-82f0-567ccaf719cc None None] [instance: c3d07e7d-a00e-4a8b-81e3-902cf007cde2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537172.5135388, 51cd87b7-e26e-4bb0-9b07-8f22e3244935 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] VM Resumed (Lifecycle Event)
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Instance spawned successfully.
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Creating image(s)
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Ensure instance console log exists: /opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Start _get_guest_xml network_info=[{"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a9b36cd0-9c51-4f47-bc31-109876904f61', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '330c761e-bda2-45ac-8731-fe511b40624c', 'attached_at': '', 'detached_at': '', 'volume_id': '71eafcd6-2945-46a2-b22c-7e20d018c7a5', 'serial': '71eafcd6-2945-46a2-b22c-7e20d018c7a5'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:12 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 08 23:26:12 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537172.5176177, 51cd87b7-e26e-4bb0-9b07-8f22e3244935 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] VM Started (Lifecycle Event)
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'vcpu_model' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:12 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:12 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:12 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8577a65-4d73-44cd-ad2a-9f6bb7300224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:26:12 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 08 23:26:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[def514ec-f7cf-4f30-9063-a572f3f2260a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5] added
Aug 08 23:26:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4539587-8752-4965-92cd-b7b088851416]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5844f6-a6d1-4584-b979-44a59378b2e7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaSuXHCP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaSuXHCP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16100e3-9fbb-4e9d-9423-307b6deb20f5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaSuXHCP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: INFO nova.compute.manager [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Took 7.06 seconds to build instance.
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6887a67-daa3-4b0f-8a31-8819760292cf]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e52464cb-aa72-433a-a27e-a1b751be1671 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.181s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71be2f6-7e91-428b-8fec-0f871134bf27]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3b1d8c-2680-4dc6-b442-1c1d3ac27da3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]
Aug 08 23:26:12 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.
Aug 08 23:26:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6156dd8f-4545-45eb-a557-2c081daee452]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c911298-3d10-46a3-9c2e-0e6d63007648]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:12 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd33c3-51a0-40d6-a43a-abcd753eff27]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:26:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23065333635326238', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065333635326238', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1614868477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-674469148',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2/Tv+b0uztkXHMREr0UP8T0i6R/8JrjK1hb5/JEax3JDtvpPQmo4hkEAoigmfGRTl79Pw59QXqqVHqBZYXTbZQ9o/acWpERhf3mjn3D88m8ZJHZVoYA1j9Wo3IojtHjw==',key_name='tempest-keypair-861392922',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21f0a5ebefd74f72810befd87bf0555e',ramdisk_id='',reservation_id='r-wzbbfqxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1828337581',owner_user_name='tempest-ServerActionsV293TestJSON-1828337581-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0bf5d8840da4cf6b94c2b86218e56b2',uuid=330c761e-bda2-45ac-8731-fe511b40624c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converting VIF {"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:26:13 user nova-compute[72405]:   <uuid>330c761e-bda2-45ac-8731-fe511b40624c</uuid>
Aug 08 23:26:13 user nova-compute[72405]:   <name>instance-0000000b</name>
Aug 08 23:26:13 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:26:13 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:26:13 user nova-compute[72405]:   <metadata>
Aug 08 23:26:13 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:26:13 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:26:13 user nova-compute[72405]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1614868477</nova:name>
Aug 08 23:26:13 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:26:12</nova:creationTime>
Aug 08 23:26:13 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:26:13 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:26:13 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:26:13 user nova-compute[72405]:       <nova:owner>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:user uuid="f0bf5d8840da4cf6b94c2b86218e56b2">tempest-ServerActionsV293TestJSON-1828337581-project-member</nova:user>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:project uuid="21f0a5ebefd74f72810befd87bf0555e">tempest-ServerActionsV293TestJSON-1828337581</nova:project>
Aug 08 23:26:13 user nova-compute[72405]:       </nova:owner>
Aug 08 23:26:13 user nova-compute[72405]:       <nova:ports>
Aug 08 23:26:13 user nova-compute[72405]:         <nova:port uuid="9b7b490f-5f0c-4df2-b016-5f494f3b0b3a">
Aug 08 23:26:13 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:26:13 user nova-compute[72405]:         </nova:port>
Aug 08 23:26:13 user nova-compute[72405]:       </nova:ports>
Aug 08 23:26:13 user nova-compute[72405]:     </nova:instance>
Aug 08 23:26:13 user nova-compute[72405]:   </metadata>
Aug 08 23:26:13 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:26:13 user nova-compute[72405]:     <system>
Aug 08 23:26:13 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:26:13 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:26:13 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:26:13 user nova-compute[72405]:       <entry name="serial">330c761e-bda2-45ac-8731-fe511b40624c</entry>
Aug 08 23:26:13 user nova-compute[72405]:       <entry name="uuid">330c761e-bda2-45ac-8731-fe511b40624c</entry>
Aug 08 23:26:13 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:26:13 user nova-compute[72405]:     </system>
Aug 08 23:26:13 user nova-compute[72405]:   </sysinfo>
Aug 08 23:26:13 user nova-compute[72405]:   <os>
Aug 08 23:26:13 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:26:13 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:26:13 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:26:13 user nova-compute[72405]:   </os>
Aug 08 23:26:13 user nova-compute[72405]:   <features>
Aug 08 23:26:13 user nova-compute[72405]:     <acpi/>
Aug 08 23:26:13 user nova-compute[72405]:     <apic/>
Aug 08 23:26:13 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:26:13 user nova-compute[72405]:   </features>
Aug 08 23:26:13 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:26:13 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:26:13 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:26:13 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:26:13 user nova-compute[72405]:   </clock>
Aug 08 23:26:13 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:26:13 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:26:13 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:26:13 user nova-compute[72405]:   </cpu>
Aug 08 23:26:13 user nova-compute[72405]:   <devices>
Aug 08 23:26:13 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:26:13 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:26:13 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:26:13 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:26:13 user nova-compute[72405]:       <serial>71eafcd6-2945-46a2-b22c-7e20d018c7a5</serial>
Aug 08 23:26:13 user nova-compute[72405]:     </disk>
Aug 08 23:26:13 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:26:13 user nova-compute[72405]:       <mac address="fa:16:3e:dd:bb:19"/>
Aug 08 23:26:13 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:13 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:26:13 user nova-compute[72405]:       <target dev="tap9b7b490f-5f"/>
Aug 08 23:26:13 user nova-compute[72405]:     </interface>
Aug 08 23:26:13 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:26:13 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c/console.log" append="off"/>
Aug 08 23:26:13 user nova-compute[72405]:     </serial>
Aug 08 23:26:13 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:26:13 user nova-compute[72405]:     <video>
Aug 08 23:26:13 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:13 user nova-compute[72405]:     </video>
Aug 08 23:26:13 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:26:13 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:26:13 user nova-compute[72405]:     </rng>
Aug 08 23:26:13 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:26:13 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:26:13 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:26:13 user nova-compute[72405]:     </memballoon>
Aug 08 23:26:13 user nova-compute[72405]:   </devices>
Aug 08 23:26:13 user nova-compute[72405]: </domain>
Aug 08 23:26:13 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1614868477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-674469148',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2/Tv+b0uztkXHMREr0UP8T0i6R/8JrjK1hb5/JEax3JDtvpPQmo4hkEAoigmfGRTl79Pw59QXqqVHqBZYXTbZQ9o/acWpERhf3mjn3D88m8ZJHZVoYA1j9Wo3IojtHjw==',key_name='tempest-keypair-861392922',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21f0a5ebefd74f72810befd87bf0555e',ramdisk_id='',reservation_id='r-wzbbfqxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1828337581',owner_user_name='tempest-ServerActionsV293TestJSON-1828337581-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0bf5d8840da4cf6b94c2b86218e56b2',uuid=330c761e-bda2-45ac-8731-fe511b40624c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converting VIF {"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG os_vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b7b490f-5f, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b7b490f-5f, col_values=(('external_ids', {'iface-id': '9b7b490f-5f0c-4df2-b016-5f494f3b0b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:bb:19', 'vm-uuid': '330c761e-bda2-45ac-8731-fe511b40624c'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:14 user nova-compute[72405]: INFO os_vif [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f')
Aug 08 23:26:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:26:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] No VIF found with MAC fa:16:3e:dd:bb:19, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-25a0eb09-0f30-4ff9-8edb-c18fe31e0d2a req-cc1fb46e-9f15-457b-8311-56eabf379208 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-25a0eb09-0f30-4ff9-8edb-c18fe31e0d2a req-cc1fb46e-9f15-457b-8311-56eabf379208 service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-25a0eb09-0f30-4ff9-8edb-c18fe31e0d2a req-cc1fb46e-9f15-457b-8311-56eabf379208 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-25a0eb09-0f30-4ff9-8edb-c18fe31e0d2a req-cc1fb46e-9f15-457b-8311-56eabf379208 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-25a0eb09-0f30-4ff9-8edb-c18fe31e0d2a req-cc1fb46e-9f15-457b-8311-56eabf379208 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:15 user nova-compute[72405]: WARNING nova.compute.manager [req-25a0eb09-0f30-4ff9-8edb-c18fe31e0d2a req-cc1fb46e-9f15-457b-8311-56eabf379208 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state active and task_state rebuild_spawning.
Aug 08 23:26:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-662ea79b-ea91-4a54-ab01-87ce03d5ee89 req-8f1d7795-be3f-4ca9-9e76-55282c2bae89 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-662ea79b-ea91-4a54-ab01-87ce03d5ee89 req-8f1d7795-be3f-4ca9-9e76-55282c2bae89 service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-662ea79b-ea91-4a54-ab01-87ce03d5ee89 req-8f1d7795-be3f-4ca9-9e76-55282c2bae89 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-662ea79b-ea91-4a54-ab01-87ce03d5ee89 req-8f1d7795-be3f-4ca9-9e76-55282c2bae89 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-662ea79b-ea91-4a54-ab01-87ce03d5ee89 req-8f1d7795-be3f-4ca9-9e76-55282c2bae89 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:17 user nova-compute[72405]: WARNING nova.compute.manager [req-662ea79b-ea91-4a54-ab01-87ce03d5ee89 req-8f1d7795-be3f-4ca9-9e76-55282c2bae89 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state active and task_state rebuild_spawning.
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537177.8815162, 330c761e-bda2-45ac-8731-fe511b40624c => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] VM Resumed (Lifecycle Event)
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:26:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance spawned successfully.
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537177.88242, 330c761e-bda2-45ac-8731-fe511b40624c => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] VM Started (Lifecycle Event)
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:18 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 08 23:26:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72405) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 08 23:26:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-53dac6d6-750d-4c7a-9e5e-cd8d75a3ec56 tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.103s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:20 user nova-compute[72405]: INFO nova.compute.manager [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Terminating instance
Aug 08 23:26:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-a7299d49-e370-4987-a930-f4bd0bb95a1b req-b7690b96-be12-46d6-bcc0-9c9d9dcf8bef service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-unplugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a7299d49-e370-4987-a930-f4bd0bb95a1b req-b7690b96-be12-46d6-bcc0-9c9d9dcf8bef service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a7299d49-e370-4987-a930-f4bd0bb95a1b req-b7690b96-be12-46d6-bcc0-9c9d9dcf8bef service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a7299d49-e370-4987-a930-f4bd0bb95a1b req-b7690b96-be12-46d6-bcc0-9c9d9dcf8bef service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-a7299d49-e370-4987-a930-f4bd0bb95a1b req-b7690b96-be12-46d6-bcc0-9c9d9dcf8bef service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-unplugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-a7299d49-e370-4987-a930-f4bd0bb95a1b req-b7690b96-be12-46d6-bcc0-9c9d9dcf8bef service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-unplugged-67827618-228c-474c-adaf-4692e1251fc1 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:26:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Instance destroyed successfully.
Aug 08 23:26:21 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lazy-loading 'resources' on Instance uuid 29c4e0e6-85dc-4db6-a801-2ff6a19115db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-714913135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-714913135',id=8,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAJOLgBGB3Ov0jgHUDVreoTeYEtrQbVGAoIh2YDYS/Uk/r15bSfEgWmrAL4QAwFm1fMHnYpxMI2POINKe13VDASbOSLspwO/JQNE5n0P8twjFTd0k8hfYg+TYlfeSVtyA==',key_name='tempest-keypair-310241501',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4229ea3198b846819520ed06edf0eecd',ramdisk_id='',reservation_id='r-2lz8qfyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-628633788',owner_user_name='tempest-TaggedAttachmentsTest-628633788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1da7c19e65443d49ebd11d20955166f',uuid=29c4e0e6-85dc-4db6-a801-2ff6a19115db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converting VIF {"id": "67827618-228c-474c-adaf-4692e1251fc1", "address": "fa:16:3e:b0:85:4a", "network": {"id": "b3584762-c37a-4f04-bfe1-c68641791cf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468519536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4229ea3198b846819520ed06edf0eecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67827618-22", "ovs_interfaceid": "67827618-228c-474c-adaf-4692e1251fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG os_vif [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67827618-22, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:21 user nova-compute[72405]: INFO os_vif [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:85:4a,bridge_name='br-int',has_traffic_filtering=True,id=67827618-228c-474c-adaf-4692e1251fc1,network=Network(b3584762-c37a-4f04-bfe1-c68641791cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67827618-22')
Aug 08 23:26:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Deleting instance files /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db_del
Aug 08 23:26:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Deletion of /opt/stack/data/nova/instances/29c4e0e6-85dc-4db6-a801-2ff6a19115db_del complete
Aug 08 23:26:21 user nova-compute[72405]: INFO nova.compute.manager [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 08 23:26:21 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:26:21 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:26:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-84ca3ecf-d8d9-4deb-864e-f3d7b36632bf req-60c2ca4a-b51b-4cd2-bea4-4f4937cc6486 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84ca3ecf-d8d9-4deb-864e-f3d7b36632bf req-60c2ca4a-b51b-4cd2-bea4-4f4937cc6486 service nova] Acquiring lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84ca3ecf-d8d9-4deb-864e-f3d7b36632bf req-60c2ca4a-b51b-4cd2-bea4-4f4937cc6486 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84ca3ecf-d8d9-4deb-864e-f3d7b36632bf req-60c2ca4a-b51b-4cd2-bea4-4f4937cc6486 service nova] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-84ca3ecf-d8d9-4deb-864e-f3d7b36632bf req-60c2ca4a-b51b-4cd2-bea4-4f4937cc6486 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] No waiting events found dispatching network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:22 user nova-compute[72405]: WARNING nova.compute.manager [req-84ca3ecf-d8d9-4deb-864e-f3d7b36632bf req-60c2ca4a-b51b-4cd2-bea4-4f4937cc6486 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received unexpected event network-vif-plugged-67827618-228c-474c-adaf-4692e1251fc1 for instance with vm_state active and task_state deleting.
Aug 08 23:26:23 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1ef0b33-9150-4915-b141-e0484119de34 req-9f8bf939-2fa4-4998-927f-5cf664681bb2 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Received event network-vif-deleted-67827618-228c-474c-adaf-4692e1251fc1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:23 user nova-compute[72405]: INFO nova.compute.manager [req-e1ef0b33-9150-4915-b141-e0484119de34 req-9f8bf939-2fa4-4998-927f-5cf664681bb2 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Neutron deleted interface 67827618-228c-474c-adaf-4692e1251fc1; detaching it from the instance and deleting it from the info cache
Aug 08 23:26:23 user nova-compute[72405]: DEBUG nova.network.neutron [req-e1ef0b33-9150-4915-b141-e0484119de34 req-9f8bf939-2fa4-4998-927f-5cf664681bb2 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:23 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Took 1.90 seconds to deallocate network for instance.
Aug 08 23:26:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1ef0b33-9150-4915-b141-e0484119de34 req-9f8bf939-2fa4-4998-927f-5cf664681bb2 service nova] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Detach interface failed, port_id=67827618-228c-474c-adaf-4692e1251fc1, reason: Instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:26:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:23 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:23 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:23 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Deleted allocations for instance 29c4e0e6-85dc-4db6-a801-2ff6a19115db
Aug 08 23:26:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2fcf66e9-fcb8-485f-a57f-1ee2c2827d64 tempest-TaggedAttachmentsTest-628633788 tempest-TaggedAttachmentsTest-628633788-project-member] Lock "29c4e0e6-85dc-4db6-a801-2ff6a19115db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.592s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:26:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:26:25 user nova-compute[72405]: INFO nova.compute.claims [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Claim successful on node user
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:26 user nova-compute[72405]: INFO nova.compute.manager [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Terminating instance
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:26:26 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:26:26 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Creating image(s)
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "/opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "/opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.policy [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66b18b3f5935470f8d6b531f058c7d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac407be4c6ba4c17aae707e8546caab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-644a3566-605f-4531-a57e-1da6cf2fc130 req-60bf523a-bdf9-4680-87ba-5e84824d9181 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-vif-unplugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-644a3566-605f-4531-a57e-1da6cf2fc130 req-60bf523a-bdf9-4680-87ba-5e84824d9181 service nova] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-644a3566-605f-4531-a57e-1da6cf2fc130 req-60bf523a-bdf9-4680-87ba-5e84824d9181 service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-644a3566-605f-4531-a57e-1da6cf2fc130 req-60bf523a-bdf9-4680-87ba-5e84824d9181 service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-644a3566-605f-4531-a57e-1da6cf2fc130 req-60bf523a-bdf9-4680-87ba-5e84824d9181 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] No waiting events found dispatching network-vif-unplugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-644a3566-605f-4531-a57e-1da6cf2fc130 req-60bf523a-bdf9-4680-87ba-5e84824d9181 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-vif-unplugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk 1073741824" returned: 0 in 0.056s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.177s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Instance destroyed successfully.
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lazy-loading 'resources' on Instance uuid 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-332585741',display_name='tempest-VolumesAssistedSnapshotsTest-server-332585741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-332585741',id=9,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQupi3+JSAvYZ6zaUQN/WOWxwNOudIgaRdjPoaZWVFipuA+sj+aRCcV/HPYTnmAwoXPPnW/6uf/2+DOV9P1NafEWPJbcqUnx/mbt9jTF8xlP+8iDvEezRjPaOWG31IGaA==',key_name='tempest-keypair-1180597893',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dfc467e1dd844cebc771eecceb0165b',ramdisk_id='',reservation_id='r-ycflo6vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1098924015',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1098924015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d3f2bd429df4f66ae1d88b134d79709',uuid=6fc8f536-c8af-44f0-91e7-4f68cceb4fdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Converting VIF {"id": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "address": "fa:16:3e:33:4d:d2", "network": {"id": "25a0eef5-71b1-4637-87ca-193284d45581", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-780221569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfc467e1dd844cebc771eecceb0165b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0485d2-87", "ovs_interfaceid": "fe0485d2-87fd-4758-a55c-8d8c180a6dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG os_vif [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe0485d2-87, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Cannot resize image /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lazy-loading 'migration_context' on Instance uuid c3e19ae0-d188-4ed4-80f1-569c5785f5e4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:27 user nova-compute[72405]: INFO os_vif [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:4d:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe0485d2-87fd-4758-a55c-8d8c180a6dee,network=Network(25a0eef5-71b1-4637-87ca-193284d45581),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0485d2-87')
Aug 08 23:26:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Deleting instance files /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb_del
Aug 08 23:26:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Deletion of /opt/stack/data/nova/instances/6fc8f536-c8af-44f0-91e7-4f68cceb4fdb_del complete
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Ensure instance console log exists: /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:27 user nova-compute[72405]: INFO nova.compute.manager [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 08 23:26:27 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:26:27 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:28 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Took 1.03 seconds to deallocate network for instance.
Aug 08 23:26:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Successfully created port: 70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] Acquiring lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] No waiting events found dispatching network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:28 user nova-compute[72405]: WARNING nova.compute.manager [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received unexpected event network-vif-plugged-fe0485d2-87fd-4758-a55c-8d8c180a6dee for instance with vm_state deleted and task_state None.
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-79185e4b-5444-46d3-904f-333564c0ba7e req-0106bd91-39b8-444f-a6b7-cee1c2ae9882 service nova] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Received event network-vif-deleted-fe0485d2-87fd-4758-a55c-8d8c180a6dee {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:28 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Deleted allocations for instance 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d36cc7ce-bb6d-4381-a8ec-93f28d9f81fd tempest-VolumesAssistedSnapshotsTest-1098924015 tempest-VolumesAssistedSnapshotsTest-1098924015-project-member] Lock "6fc8f536-c8af-44f0-91e7-4f68cceb4fdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.708s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updating instance_info_cache with network_info: [{"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-2b6e716f-3376-4f79-8ad5-95bd1d5231f7" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:26:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Successfully updated port: 70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "refresh_cache-c3e19ae0-d188-4ed4-80f1-569c5785f5e4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquired lock "refresh_cache-c3e19ae0-d188-4ed4-80f1-569c5785f5e4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-changed-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Refreshing instance network info cache due to event network-changed-70d723e8-ffab-45b2-8455-a96d579d5e06. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] Acquiring lock "refresh_cache-c3e19ae0-d188-4ed4-80f1-569c5785f5e4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Updating instance_info_cache with network_info: [{"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Releasing lock "refresh_cache-c3e19ae0-d188-4ed4-80f1-569c5785f5e4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Instance network_info: |[{"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] Acquired lock "refresh_cache-c3e19ae0-d188-4ed4-80f1-569c5785f5e4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Refreshing network info cache for port 70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Start _get_guest_xml network_info=[{"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:30 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:30 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:26:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-418018861',display_name='tempest-VolumesNegativeTest-instance-418018861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-418018861',id=16,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac407be4c6ba4c17aae707e8546caab1',ramdisk_id='',reservation_id='r-zb8kysqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-411144724',owner_user_name='tempest-VolumesNegativeTest-411144724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:26Z,user_data=None,user_id='66b18b3f5935470f8d6b531f058c7d8c',uuid=c3e19ae0-d188-4ed4-80f1-569c5785f5e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Converting VIF {"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lazy-loading 'pci_devices' on Instance uuid c3e19ae0-d188-4ed4-80f1-569c5785f5e4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:26:31 user nova-compute[72405]:   <uuid>c3e19ae0-d188-4ed4-80f1-569c5785f5e4</uuid>
Aug 08 23:26:31 user nova-compute[72405]:   <name>instance-00000010</name>
Aug 08 23:26:31 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:26:31 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:26:31 user nova-compute[72405]:   <metadata>
Aug 08 23:26:31 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:26:31 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:26:31 user nova-compute[72405]:       <nova:name>tempest-VolumesNegativeTest-instance-418018861</nova:name>
Aug 08 23:26:31 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:26:30</nova:creationTime>
Aug 08 23:26:31 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:26:31 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:26:31 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:26:31 user nova-compute[72405]:       <nova:owner>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:user uuid="66b18b3f5935470f8d6b531f058c7d8c">tempest-VolumesNegativeTest-411144724-project-member</nova:user>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:project uuid="ac407be4c6ba4c17aae707e8546caab1">tempest-VolumesNegativeTest-411144724</nova:project>
Aug 08 23:26:31 user nova-compute[72405]:       </nova:owner>
Aug 08 23:26:31 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:26:31 user nova-compute[72405]:       <nova:ports>
Aug 08 23:26:31 user nova-compute[72405]:         <nova:port uuid="70d723e8-ffab-45b2-8455-a96d579d5e06">
Aug 08 23:26:31 user nova-compute[72405]:           <nova:ip type="fixed" address="192.168.233.12" ipVersion="4"/>
Aug 08 23:26:31 user nova-compute[72405]:         </nova:port>
Aug 08 23:26:31 user nova-compute[72405]:       </nova:ports>
Aug 08 23:26:31 user nova-compute[72405]:     </nova:instance>
Aug 08 23:26:31 user nova-compute[72405]:   </metadata>
Aug 08 23:26:31 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:26:31 user nova-compute[72405]:     <system>
Aug 08 23:26:31 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:26:31 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:26:31 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:26:31 user nova-compute[72405]:       <entry name="serial">c3e19ae0-d188-4ed4-80f1-569c5785f5e4</entry>
Aug 08 23:26:31 user nova-compute[72405]:       <entry name="uuid">c3e19ae0-d188-4ed4-80f1-569c5785f5e4</entry>
Aug 08 23:26:31 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:26:31 user nova-compute[72405]:     </system>
Aug 08 23:26:31 user nova-compute[72405]:   </sysinfo>
Aug 08 23:26:31 user nova-compute[72405]:   <os>
Aug 08 23:26:31 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:26:31 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:26:31 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:26:31 user nova-compute[72405]:   </os>
Aug 08 23:26:31 user nova-compute[72405]:   <features>
Aug 08 23:26:31 user nova-compute[72405]:     <acpi/>
Aug 08 23:26:31 user nova-compute[72405]:     <apic/>
Aug 08 23:26:31 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:26:31 user nova-compute[72405]:   </features>
Aug 08 23:26:31 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:26:31 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:26:31 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:26:31 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:26:31 user nova-compute[72405]:   </clock>
Aug 08 23:26:31 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:26:31 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:26:31 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:26:31 user nova-compute[72405]:   </cpu>
Aug 08 23:26:31 user nova-compute[72405]:   <devices>
Aug 08 23:26:31 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:26:31 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:26:31 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk"/>
Aug 08 23:26:31 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:26:31 user nova-compute[72405]:     </disk>
Aug 08 23:26:31 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:26:31 user nova-compute[72405]:       <mac address="fa:16:3e:b8:44:79"/>
Aug 08 23:26:31 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:31 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:26:31 user nova-compute[72405]:       <target dev="tap70d723e8-ff"/>
Aug 08 23:26:31 user nova-compute[72405]:     </interface>
Aug 08 23:26:31 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:26:31 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/console.log" append="off"/>
Aug 08 23:26:31 user nova-compute[72405]:     </serial>
Aug 08 23:26:31 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:26:31 user nova-compute[72405]:     <video>
Aug 08 23:26:31 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:31 user nova-compute[72405]:     </video>
Aug 08 23:26:31 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:26:31 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:26:31 user nova-compute[72405]:     </rng>
Aug 08 23:26:31 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:26:31 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:26:31 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:26:31 user nova-compute[72405]:     </memballoon>
Aug 08 23:26:31 user nova-compute[72405]:   </devices>
Aug 08 23:26:31 user nova-compute[72405]: </domain>
Aug 08 23:26:31 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-418018861',display_name='tempest-VolumesNegativeTest-instance-418018861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-418018861',id=16,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac407be4c6ba4c17aae707e8546caab1',ramdisk_id='',reservation_id='r-zb8kysqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-411144724',owner_user_name='tempest-VolumesNegativeTest-411144724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:26Z,user_data=None,user_id='66b18b3f5935470f8d6b531f058c7d8c',uuid=c3e19ae0-d188-4ed4-80f1-569c5785f5e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Converting VIF {"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG os_vif [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d723e8-ff, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70d723e8-ff, col_values=(('external_ids', {'iface-id': '70d723e8-ffab-45b2-8455-a96d579d5e06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:44:79', 'vm-uuid': 'c3e19ae0-d188-4ed4-80f1-569c5785f5e4'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:31 user nova-compute[72405]: INFO os_vif [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff')
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] No VIF found with MAC fa:16:3e:b8:44:79, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Updated VIF entry in instance network info cache for port 70d723e8-ffab-45b2-8455-a96d579d5e06. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Updating instance_info_cache with network_info: [{"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-57c59080-5d8d-4ab5-9e7e-51f08078c53c req-cb48350c-b9a4-47a5-b5ff-83e4b94f351f service nova] Releasing lock "refresh_cache-c3e19ae0-d188-4ed4-80f1-569c5785f5e4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537194.845401, c3e19ae0-d188-4ed4-80f1-569c5785f5e4 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] VM Resumed (Lifecycle Event)
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-0e7c4e1e-8d98-4f9c-af4c-ab0cf377c5ec req-d79f9c28-27bf-4e60-9ad9-8f53a0d55c7e service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0e7c4e1e-8d98-4f9c-af4c-ab0cf377c5ec req-d79f9c28-27bf-4e60-9ad9-8f53a0d55c7e service nova] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0e7c4e1e-8d98-4f9c-af4c-ab0cf377c5ec req-d79f9c28-27bf-4e60-9ad9-8f53a0d55c7e service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0e7c4e1e-8d98-4f9c-af4c-ab0cf377c5ec req-d79f9c28-27bf-4e60-9ad9-8f53a0d55c7e service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-0e7c4e1e-8d98-4f9c-af4c-ab0cf377c5ec req-d79f9c28-27bf-4e60-9ad9-8f53a0d55c7e service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] No waiting events found dispatching network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:35 user nova-compute[72405]: WARNING nova.compute.manager [req-0e7c4e1e-8d98-4f9c-af4c-ab0cf377c5ec req-d79f9c28-27bf-4e60-9ad9-8f53a0d55c7e service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received unexpected event network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 for instance with vm_state building and task_state spawning.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-1abda491-7547-48dc-b7d7-fad7c5881298 req-334ec386-fc6a-4a21-aebd-16bada7a0a4f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1abda491-7547-48dc-b7d7-fad7c5881298 req-334ec386-fc6a-4a21-aebd-16bada7a0a4f service nova] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1abda491-7547-48dc-b7d7-fad7c5881298 req-334ec386-fc6a-4a21-aebd-16bada7a0a4f service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1abda491-7547-48dc-b7d7-fad7c5881298 req-334ec386-fc6a-4a21-aebd-16bada7a0a4f service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-1abda491-7547-48dc-b7d7-fad7c5881298 req-334ec386-fc6a-4a21-aebd-16bada7a0a4f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] No waiting events found dispatching network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:35 user nova-compute[72405]: WARNING nova.compute.manager [req-1abda491-7547-48dc-b7d7-fad7c5881298 req-334ec386-fc6a-4a21-aebd-16bada7a0a4f service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received unexpected event network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 for instance with vm_state building and task_state spawning.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:35 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:35 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=25.626571655273438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Instance spawned successfully.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537194.8470745, c3e19ae0-d188-4ed4-80f1-569c5785f5e4 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] VM Started (Lifecycle Event)
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 760574b8-2c65-4bb3-9ea6-1462bd32774b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 330c761e-bda2-45ac-8731-fe511b40624c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 51cd87b7-e26e-4bb0-9b07-8f22e3244935 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance c3e19ae0-d188-4ed4-80f1-569c5785f5e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Took 9.34 seconds to spawn the instance on the hypervisor.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:35 user nova-compute[72405]: INFO nova.compute.manager [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Took 10.33 seconds to build instance.
Aug 08 23:26:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f300cce9-316c-4b3a-be31-a932dbca06cd tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.448s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537181.3363688, 29c4e0e6-85dc-4db6-a801-2ff6a19115db => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:36 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] VM Stopped (Lifecycle Event)
Aug 08 23:26:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7bc0f39a-9d09-4f7e-b1b6-1efe12c349e5 None None] [instance: 29c4e0e6-85dc-4db6-a801-2ff6a19115db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:26:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:26:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'info_cache' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537187.2472742, 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:42 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] VM Stopped (Lifecycle Event)
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d4ddfacc-3264-4116-82b3-312f70f5d2df None None] [instance: 6fc8f536-c8af-44f0-91e7-4f68cceb4fdb] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance destroyed successfully.
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'resources' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8654907e-98, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:42 user nova-compute[72405]: INFO os_vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98')
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:42 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c458d9-7c15-47c8-971a-671e26d1f1bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf38cb1-a70b-4ea9-9ffc-c8afbb9254ad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:42 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:42 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:42 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:42 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:42 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:42 user nova-compute[72405]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:42 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:42 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9808dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'): ({'sdf'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Removing single pathed devices sdf {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[618fb682-c0f5-497e-a3da-2d5a3f4e68f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fcab43-0f81-468b-bae2-9099675e806d]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flushing IO for device /dev/sdf {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbab505-e2f2-4097-82cb-ea1d59d2649f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd2726-ce95-4e52-a79c-315cfe3fc65d]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b14198-19bc-4b7c-8f8e-33607c742160]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f238ceee-06ea-4511-ac3f-1dfc97b3d180]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]
Aug 08 23:26:42 user nova-compute[72405]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.
Aug 08 23:26:42 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5988da7-e9fd-4b2b-9132-091ee265ed09]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== disconnect_volume: return (309ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start _get_guest_xml network_info=[{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ca493d58-8245-4740-a988-88691359f8a7', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '80e7599c-bd2a-499d-9b2b-4c613f375900', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb83d67a-835b-403c-8a53-b4289f44490e', 'serial': 'fb83d67a-835b-403c-8a53-b4289f44490e'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'numa_topology' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:42 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:42 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:26:42 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13ddc2-df11-4e8e-85a4-a1ac0ada4ecf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:26:42 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e46e73-2043-476a-8baa-9ec390488ac2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e] added
Aug 08 23:26:42 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa7f36-d1f1-45c7-9428-25896216946b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6123316f-0479-4218-926d-60553114903b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqvxiMfE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqvxiMfE" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[189ac535-fbbf-4ee6-a493-8397c5aeb2e0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqvxiMfE'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e75c5a-3c42-46b5-a53e-355244f4846a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8938da0d-5480-48a0-8690-745daaf95fd3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[094badd3-a413-4f9d-82a6-5e51274505a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]
Aug 08 23:26:43 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.
Aug 08 23:26:43 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9fcbd5-8d15-4742-904f-707f7370599a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce2d492-677a-413b-8415-86823abe1967]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:26:43 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:26:43 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e204610c-e70b-4606-8ad2-2fbf73483a72]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:43 user nova-compute[72405]: INFO nova.compute.manager [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Unshelving
Aug 08 23:26:43 user nova-compute[72405]: INFO nova.virt.block_device [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Booting with volume 70079ec1-e2b4-43e8-9278-2c732633c108 at /dev/vdc
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.utils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13e056-e61e-4e23-aee2-140e45f2c915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130733d-cc0b-405c-8eba-f3fbba168b08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bb74a8-d870-4546-8565-e66e3eb1e9f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[048dad11-e5bb-4ce7-b461-fe0254779439]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:26:43 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:26:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc651d1-aeab-4b28-8626-c042cc381bfb]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG os_brick.utils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:43 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating existing volume attachment record: 2fdf1e7b-0c94-4542-b205-1663a545f2d5 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26132613331663565', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132613331663565', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:26:44 user nova-compute[72405]:   <uuid>80e7599c-bd2a-499d-9b2b-4c613f375900</uuid>
Aug 08 23:26:44 user nova-compute[72405]:   <name>instance-00000003</name>
Aug 08 23:26:44 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:26:44 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:26:44 user nova-compute[72405]:   <metadata>
Aug 08 23:26:44 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:26:44 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:26:44 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeTestJSON-server-1585614820</nova:name>
Aug 08 23:26:44 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:26:42</nova:creationTime>
Aug 08 23:26:44 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:26:44 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:26:44 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:26:44 user nova-compute[72405]:       <nova:owner>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:user uuid="e934b55e46634b7097bb144b74ac5954">tempest-AttachVolumeTestJSON-1838616528-project-member</nova:user>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:project uuid="72ebca86ade54e1f9805255b64901be8">tempest-AttachVolumeTestJSON-1838616528</nova:project>
Aug 08 23:26:44 user nova-compute[72405]:       </nova:owner>
Aug 08 23:26:44 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:26:44 user nova-compute[72405]:       <nova:ports>
Aug 08 23:26:44 user nova-compute[72405]:         <nova:port uuid="8654907e-9844-4cf4-8754-5b540b3aa53c">
Aug 08 23:26:44 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:26:44 user nova-compute[72405]:         </nova:port>
Aug 08 23:26:44 user nova-compute[72405]:       </nova:ports>
Aug 08 23:26:44 user nova-compute[72405]:     </nova:instance>
Aug 08 23:26:44 user nova-compute[72405]:   </metadata>
Aug 08 23:26:44 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:26:44 user nova-compute[72405]:     <system>
Aug 08 23:26:44 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:26:44 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:26:44 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:26:44 user nova-compute[72405]:       <entry name="serial">80e7599c-bd2a-499d-9b2b-4c613f375900</entry>
Aug 08 23:26:44 user nova-compute[72405]:       <entry name="uuid">80e7599c-bd2a-499d-9b2b-4c613f375900</entry>
Aug 08 23:26:44 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:26:44 user nova-compute[72405]:     </system>
Aug 08 23:26:44 user nova-compute[72405]:   </sysinfo>
Aug 08 23:26:44 user nova-compute[72405]:   <os>
Aug 08 23:26:44 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:26:44 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:26:44 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:26:44 user nova-compute[72405]:   </os>
Aug 08 23:26:44 user nova-compute[72405]:   <features>
Aug 08 23:26:44 user nova-compute[72405]:     <acpi/>
Aug 08 23:26:44 user nova-compute[72405]:     <apic/>
Aug 08 23:26:44 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:26:44 user nova-compute[72405]:   </features>
Aug 08 23:26:44 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:26:44 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:26:44 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:26:44 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:26:44 user nova-compute[72405]:   </clock>
Aug 08 23:26:44 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:26:44 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:26:44 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:26:44 user nova-compute[72405]:   </cpu>
Aug 08 23:26:44 user nova-compute[72405]:   <devices>
Aug 08 23:26:44 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:26:44 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:26:44 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk"/>
Aug 08 23:26:44 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:26:44 user nova-compute[72405]:     </disk>
Aug 08 23:26:44 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:26:44 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:26:44 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:26:44 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:26:44 user nova-compute[72405]:       <serial>fb83d67a-835b-403c-8a53-b4289f44490e</serial>
Aug 08 23:26:44 user nova-compute[72405]:     </disk>
Aug 08 23:26:44 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:26:44 user nova-compute[72405]:       <mac address="fa:16:3e:f6:53:af"/>
Aug 08 23:26:44 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:44 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:26:44 user nova-compute[72405]:       <target dev="tap8654907e-98"/>
Aug 08 23:26:44 user nova-compute[72405]:     </interface>
Aug 08 23:26:44 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:26:44 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/console.log" append="off"/>
Aug 08 23:26:44 user nova-compute[72405]:     </serial>
Aug 08 23:26:44 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:26:44 user nova-compute[72405]:     <video>
Aug 08 23:26:44 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:26:44 user nova-compute[72405]:     </video>
Aug 08 23:26:44 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:26:44 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:26:44 user nova-compute[72405]:     </rng>
Aug 08 23:26:44 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:26:44 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:26:44 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:26:44 user nova-compute[72405]:     </memballoon>
Aug 08 23:26:44 user nova-compute[72405]:   </devices>
Aug 08 23:26:44 user nova-compute[72405]: </domain>
Aug 08 23:26:44 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Cannot resize image /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'migration_context' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:24:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG os_vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:26:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8654907e-98, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8654907e-98, col_values=(('external_ids', {'iface-id': '8654907e-9844-4cf4-8754-5b540b3aa53c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:53:af', 'vm-uuid': '80e7599c-bd2a-499d-9b2b-4c613f375900'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:45 user nova-compute[72405]: INFO os_vif [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98')
Aug 08 23:26:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-63a77750-30ec-4af1-9686-89d347da770e req-96bb9734-ef1a-4756-8ce2-e88b1a701728 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-63a77750-30ec-4af1-9686-89d347da770e req-96bb9734-ef1a-4756-8ce2-e88b1a701728 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-63a77750-30ec-4af1-9686-89d347da770e req-96bb9734-ef1a-4756-8ce2-e88b1a701728 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-63a77750-30ec-4af1-9686-89d347da770e req-96bb9734-ef1a-4756-8ce2-e88b1a701728 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-63a77750-30ec-4af1-9686-89d347da770e req-96bb9734-ef1a-4756-8ce2-e88b1a701728 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:47 user nova-compute[72405]: WARNING nova.compute.manager [req-63a77750-30ec-4af1-9686-89d347da770e req-96bb9734-ef1a-4756-8ce2-e88b1a701728 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state stopped and task_state powering-on.
Aug 08 23:26:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537208.8368435, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Resumed (Lifecycle Event)
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance rebooted successfully.
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20627f7a-ed17-4615-b761-f7f5f347aa91 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537208.8372111, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:26:48 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Started (Lifecycle Event)
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:26:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:26:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-6fc1252e-59fc-4b29-9074-a440db634846 req-bb6493d0-da0e-406f-b7e9-88da3541d465 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6fc1252e-59fc-4b29-9074-a440db634846 req-bb6493d0-da0e-406f-b7e9-88da3541d465 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6fc1252e-59fc-4b29-9074-a440db634846 req-bb6493d0-da0e-406f-b7e9-88da3541d465 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6fc1252e-59fc-4b29-9074-a440db634846 req-bb6493d0-da0e-406f-b7e9-88da3541d465 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-6fc1252e-59fc-4b29-9074-a440db634846 req-bb6493d0-da0e-406f-b7e9-88da3541d465 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:49 user nova-compute[72405]: WARNING nova.compute.manager [req-6fc1252e-59fc-4b29-9074-a440db634846 req-bb6493d0-da0e-406f-b7e9-88da3541d465 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state active and task_state None.
Aug 08 23:26:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'pci_requests' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'numa_topology' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:26:53 user nova-compute[72405]: INFO nova.compute.claims [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Claim successful on node user
Aug 08 23:26:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:53 user nova-compute[72405]: INFO nova.network.neutron [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-changed-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Refreshing instance network info cache due to event network-changed-76de9722-88a4-4bc1-a074-5edbb5b51e62. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] Acquiring lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] Acquired lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Refreshing network info cache for port 76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:54 user nova-compute[72405]: INFO nova.compute.manager [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Terminating instance
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updated VIF entry in instance network info cache for port 76de9722-88a4-4bc1-a074-5edbb5b51e62. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updating instance_info_cache with network_info: [{"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-128ad134-9167-427e-abd5-32aaa03f12b4 req-69ba7141-62f0-424b-893d-5445ced5dbd9 service nova] Releasing lock "refresh_cache-4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-635dec39-257a-413b-a018-8224dc44cfc8 req-3d82120a-2826-48f7-bb9b-a807794cda8c service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-vif-unplugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-635dec39-257a-413b-a018-8224dc44cfc8 req-3d82120a-2826-48f7-bb9b-a807794cda8c service nova] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-635dec39-257a-413b-a018-8224dc44cfc8 req-3d82120a-2826-48f7-bb9b-a807794cda8c service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-635dec39-257a-413b-a018-8224dc44cfc8 req-3d82120a-2826-48f7-bb9b-a807794cda8c service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-635dec39-257a-413b-a018-8224dc44cfc8 req-3d82120a-2826-48f7-bb9b-a807794cda8c service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] No waiting events found dispatching network-vif-unplugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-635dec39-257a-413b-a018-8224dc44cfc8 req-3d82120a-2826-48f7-bb9b-a807794cda8c service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-vif-unplugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing instance network info cache due to event network-changed-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Instance destroyed successfully.
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'resources' on Instance uuid 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-498162237',display_name='tempest-AttachVolumeNegativeTest-server-498162237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-498162237',id=13,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZLdZFed1kSjFv5vVkjqgd0oHf7Rzo+h6PKZd7D1Sd75pGh+tZTW7ZDHDKUx4O6TPfM+98aP8IPDwWWFDAhnvb5nXTpIqsuKN+9uNTE0XrDf7bv0DDx6HMVxNCWe8E5rQ==',key_name='tempest-keypair-1529781642',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-m1u4cmcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=4efaaaf8-fcb6-408b-9374-e6dcdd2adaec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "address": "fa:16:3e:d9:82:9f", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76de9722-88", "ovs_interfaceid": "76de9722-88a4-4bc1-a074-5edbb5b51e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG os_vif [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76de9722-88, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:26:55 user nova-compute[72405]: INFO os_vif [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:82:9f,bridge_name='br-int',has_traffic_filtering=True,id=76de9722-88a4-4bc1-a074-5edbb5b51e62,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76de9722-88')
Aug 08 23:26:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Deleting instance files /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec_del
Aug 08 23:26:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Deletion of /opt/stack/data/nova/instances/4efaaaf8-fcb6-408b-9374-e6dcdd2adaec_del complete
Aug 08 23:26:55 user nova-compute[72405]: INFO nova.compute.manager [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:26:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Creating image(s)
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG nova.network.neutron [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Refreshing network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "05f7c0e00868f631bb36d15fdc4764fb40103e1b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "05f7c0e00868f631bb36d15fdc4764fb40103e1b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] Acquiring lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] No waiting events found dispatching network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:57 user nova-compute[72405]: WARNING nova.compute.manager [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received unexpected event network-vif-plugged-76de9722-88a4-4bc1-a074-5edbb5b51e62 for instance with vm_state active and task_state deleting.
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Received event network-vif-deleted-76de9722-88a4-4bc1-a074-5edbb5b51e62 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:57 user nova-compute[72405]: INFO nova.compute.manager [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Neutron deleted interface 76de9722-88a4-4bc1-a074-5edbb5b51e62; detaching it from the instance and deleting it from the info cache
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.part --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.virt.images [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] cf1a14f9-b145-4093-b880-ab78abe03a6a was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.part /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-eed66f41-89b3-46e2-ad93-44ee0799a79e req-46c42206-bd0c-4a37-8a70-fabf71152720 service nova] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Detach interface failed, port_id=76de9722-88a4-4bc1-a074-5edbb5b51e62, reason: Instance 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:26:57 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Took 1.80 seconds to deallocate network for instance.
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.part /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.converted" returned: 0 in 0.550s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updated VIF entry in instance network info cache for port 9a42571c-14a5-4457-b5f9-4a1de6ed2d4d. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "05f7c0e00868f631bb36d15fdc4764fb40103e1b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.064s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a91e009f-4e8d-494d-992a-633cf4136098 req-c005c8a5-f2b4-4805-957b-9b2b8548b190 service nova] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:26:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "05f7c0e00868f631bb36d15fdc4764fb40103e1b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "05f7c0e00868f631bb36d15fdc4764fb40103e1b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:58 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Deleted allocations for instance 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b,backing_fmt=raw /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d162cb46-4b58-42b4-87fd-40179791a49f tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "4efaaaf8-fcb6-408b-9374-e6dcdd2adaec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.803s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b,backing_fmt=raw /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk 1073741824" returned: 0 in 0.058s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "05f7c0e00868f631bb36d15fdc4764fb40103e1b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'migration_context' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:26:58 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Rebasing disk image.
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:26:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b -F raw /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:59 user nova-compute[72405]: INFO nova.compute.manager [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Terminating instance
Aug 08 23:26:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-ae2de5a1-a515-4bb0-be8c-dd92f244cac7 req-31abe778-4e8c-4707-954a-a35a174caf54 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-vif-unplugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ae2de5a1-a515-4bb0-be8c-dd92f244cac7 req-31abe778-4e8c-4707-954a-a35a174caf54 service nova] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ae2de5a1-a515-4bb0-be8c-dd92f244cac7 req-31abe778-4e8c-4707-954a-a35a174caf54 service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ae2de5a1-a515-4bb0-be8c-dd92f244cac7 req-31abe778-4e8c-4707-954a-a35a174caf54 service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-ae2de5a1-a515-4bb0-be8c-dd92f244cac7 req-31abe778-4e8c-4707-954a-a35a174caf54 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] No waiting events found dispatching network-vif-unplugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:26:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-ae2de5a1-a515-4bb0-be8c-dd92f244cac7 req-31abe778-4e8c-4707-954a-a35a174caf54 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-vif-unplugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Instance destroyed successfully.
Aug 08 23:27:00 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lazy-loading 'resources' on Instance uuid 760574b8-2c65-4bb3-9ea6-1462bd32774b {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1483665552',display_name='tempest-TestVolumeSwap-server-1483665552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1483665552',id=10,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgKJIQgI/c2nArGmWPDTB1wzJzYuztaj/5Vf3zXUZtXoU1mHTiVyceJfKhTDTCMIjeTWHFtYJeHz7onMucW/mdqAIGFPJWaenZ1IqqNg7B6LFkkr44ZPKMoPZ6l2YI7AA==',key_name='tempest-keypair-673977697',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae61c745857f4f8ca77b6359d25a43ee',ramdisk_id='',reservation_id='r-uxtbzltd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2102136752',owner_user_name='tempest-TestVolumeSwap-2102136752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8c422e23cce45cbb2cc478078d340c9',uuid=760574b8-2c65-4bb3-9ea6-1462bd32774b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Converting VIF {"id": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "address": "fa:16:3e:b6:36:de", "network": {"id": "ea9c7f8e-694f-405c-bb60-c0b6b967c6a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2045330202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61c745857f4f8ca77b6359d25a43ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92830d91-3d", "ovs_interfaceid": "92830d91-3d6e-44a6-98fa-048cc0b5d459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG os_vif [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92830d91-3d, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:27:00 user nova-compute[72405]: INFO os_vif [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:36:de,bridge_name='br-int',has_traffic_filtering=True,id=92830d91-3d6e-44a6-98fa-048cc0b5d459,network=Network(ea9c7f8e-694f-405c-bb60-c0b6b967c6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92830d91-3d')
Aug 08 23:27:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Deleting instance files /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b_del
Aug 08 23:27:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Deletion of /opt/stack/data/nova/instances/760574b8-2c65-4bb3-9ea6-1462bd32774b_del complete
Aug 08 23:27:00 user nova-compute[72405]: INFO nova.compute.manager [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 08 23:27:00 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:27:00 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b -F raw /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk" returned: 0 in 2.645s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Ensure instance console log exists: /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Start _get_guest_xml network_info=[{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='604800fe651baf8d67dcd57ab7f7905e',container_format='bare',created_at=2023-08-08T23:24:50Z,direct_url=<?>,disk_format='qcow2',id=cf1a14f9-b145-4093-b880-ab78abe03a6a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1634977089-shelved',owner='94f6dc799f1b4698b15a3ea91c8dbea9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-08T23:24:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2fdf1e7b-0c94-4542-b205-1663a545f2d5', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPfJQMZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '16d8b7a1-0c6b-444f-b17c-c64caa2ece8c', 'attached_at': '', 'detached_at': '', 'volume_id': '70079ec1-e2b4-43e8-9278-2c732633c108', 'serial': '70079ec1-e2b4-43e8-9278-2c732633c108'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:27:01 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:01 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='604800fe651baf8d67dcd57ab7f7905e',container_format='bare',created_at=2023-08-08T23:24:50Z,direct_url=<?>,disk_format='qcow2',id=cf1a14f9-b145-4093-b880-ab78abe03a6a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1634977089-shelved',owner='94f6dc799f1b4698b15a3ea91c8dbea9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-08T23:24:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPfJQMZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:27:01 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:27:01 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:27:01 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba5cb3-6efa-4156-97bc-c4091168fa2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:27:01 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b0f3f-4aac-4f48-8c2b-71b27f1322d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108] added
Aug 08 23:27:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a67b0e5-c874-4f0f-805f-7f56bc0fb5d1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e04e979-1cb4-497f-b5c9-5c288c1d501f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPfJQMZw {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPfJQMZw" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16252064-c4b6-4714-b3ab-39c7cf5fa381]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPfJQMZw'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0b744b-98ec-4b26-995e-803ffb67ee8d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c09ba28-3f91-4a6a-8546-6c90b7d19b45]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8853fa7-3653-4404-868b-26e6c2b77d5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260]
Aug 08 23:27:01 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260] successful.
Aug 08 23:27:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb33893-5f59-4214-9f9a-fd538d1e6620]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3cbc9f-56ba-4fef-a40a-df1024dd8328]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:01 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:01 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Took 1.21 seconds to deallocate network for instance.
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c2d60-e380-471a-957b-ecd198c84e00]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPfJQMZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-bb20621d-aa9d-4c9f-92e0-46aed4117317 req-daa0699c-5b96-47bb-a785-c5cc07feebab service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-vif-deleted-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-efbd4112-1ec9-4de3-9195-81b9488fa902 req-3e6be162-2d5f-40c0-9478-ec646d79fc35 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received event network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-efbd4112-1ec9-4de3-9195-81b9488fa902 req-3e6be162-2d5f-40c0-9478-ec646d79fc35 service nova] Acquiring lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-efbd4112-1ec9-4de3-9195-81b9488fa902 req-3e6be162-2d5f-40c0-9478-ec646d79fc35 service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-efbd4112-1ec9-4de3-9195-81b9488fa902 req-3e6be162-2d5f-40c0-9478-ec646d79fc35 service nova] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-efbd4112-1ec9-4de3-9195-81b9488fa902 req-3e6be162-2d5f-40c0-9478-ec646d79fc35 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] No waiting events found dispatching network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:02 user nova-compute[72405]: WARNING nova.compute.manager [req-efbd4112-1ec9-4de3-9195-81b9488fa902 req-3e6be162-2d5f-40c0-9478-ec646d79fc35 service nova] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Received unexpected event network-vif-plugged-92830d91-3d6e-44a6-98fa-048cc0b5d459 for instance with vm_state deleted and task_state None.
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:02 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Deleted allocations for instance 760574b8-2c65-4bb3-9ea6-1462bd32774b
Aug 08 23:27:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fdeb6746-e1a2-4f6a-bc31-0d5eac26511c tempest-TestVolumeSwap-2102136752 tempest-TestVolumeSwap-2102136752-project-member] Lock "760574b8-2c65-4bb3-9ea6-1462bd32774b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26336323066306537', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336323066306537', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1634977089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1634977089',id=5,image_ref='cf1a14f9-b145-4093-b880-ab78abe03a6a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-380907040',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-ozqx2sck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member',shelved_at='2023-08-08T23:24:55.564365',shelved_host='user',shelved_image_id='cf1a14f9-b145-4093-b880-ab78abe03a6a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=16d8b7a1-0c6b-444f-b17c-c64caa2ece8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'pci_devices' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:27:02 user nova-compute[72405]:   <uuid>16d8b7a1-0c6b-444f-b17c-c64caa2ece8c</uuid>
Aug 08 23:27:02 user nova-compute[72405]:   <name>instance-00000005</name>
Aug 08 23:27:02 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:27:02 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:27:02 user nova-compute[72405]:   <metadata>
Aug 08 23:27:02 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:27:02 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:27:02 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1634977089</nova:name>
Aug 08 23:27:02 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:27:01</nova:creationTime>
Aug 08 23:27:02 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:27:02 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:27:02 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:27:02 user nova-compute[72405]:       <nova:owner>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:user uuid="fb25719ffe4c467e8afc3f6b8fe4d712">tempest-AttachVolumeShelveTestJSON-1695202964-project-member</nova:user>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:project uuid="94f6dc799f1b4698b15a3ea91c8dbea9">tempest-AttachVolumeShelveTestJSON-1695202964</nova:project>
Aug 08 23:27:02 user nova-compute[72405]:       </nova:owner>
Aug 08 23:27:02 user nova-compute[72405]:       <nova:root type="image" uuid="cf1a14f9-b145-4093-b880-ab78abe03a6a"/>
Aug 08 23:27:02 user nova-compute[72405]:       <nova:ports>
Aug 08 23:27:02 user nova-compute[72405]:         <nova:port uuid="9a42571c-14a5-4457-b5f9-4a1de6ed2d4d">
Aug 08 23:27:02 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 08 23:27:02 user nova-compute[72405]:         </nova:port>
Aug 08 23:27:02 user nova-compute[72405]:       </nova:ports>
Aug 08 23:27:02 user nova-compute[72405]:     </nova:instance>
Aug 08 23:27:02 user nova-compute[72405]:   </metadata>
Aug 08 23:27:02 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:27:02 user nova-compute[72405]:     <system>
Aug 08 23:27:02 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:27:02 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:27:02 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:27:02 user nova-compute[72405]:       <entry name="serial">16d8b7a1-0c6b-444f-b17c-c64caa2ece8c</entry>
Aug 08 23:27:02 user nova-compute[72405]:       <entry name="uuid">16d8b7a1-0c6b-444f-b17c-c64caa2ece8c</entry>
Aug 08 23:27:02 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:27:02 user nova-compute[72405]:     </system>
Aug 08 23:27:02 user nova-compute[72405]:   </sysinfo>
Aug 08 23:27:02 user nova-compute[72405]:   <os>
Aug 08 23:27:02 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:27:02 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:27:02 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:27:02 user nova-compute[72405]:   </os>
Aug 08 23:27:02 user nova-compute[72405]:   <features>
Aug 08 23:27:02 user nova-compute[72405]:     <acpi/>
Aug 08 23:27:02 user nova-compute[72405]:     <apic/>
Aug 08 23:27:02 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:27:02 user nova-compute[72405]:   </features>
Aug 08 23:27:02 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:27:02 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:27:02 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:27:02 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:27:02 user nova-compute[72405]:   </clock>
Aug 08 23:27:02 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:27:02 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:27:02 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:27:02 user nova-compute[72405]:   </cpu>
Aug 08 23:27:02 user nova-compute[72405]:   <devices>
Aug 08 23:27:02 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:27:02 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:27:02 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk"/>
Aug 08 23:27:02 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:27:02 user nova-compute[72405]:     </disk>
Aug 08 23:27:02 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:27:02 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:27:02 user nova-compute[72405]:       <source dev="/dev/sde"/>
Aug 08 23:27:02 user nova-compute[72405]:       <target dev="vdc" bus="virtio"/>
Aug 08 23:27:02 user nova-compute[72405]:       <serial>70079ec1-e2b4-43e8-9278-2c732633c108</serial>
Aug 08 23:27:02 user nova-compute[72405]:     </disk>
Aug 08 23:27:02 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:27:02 user nova-compute[72405]:       <mac address="fa:16:3e:61:fd:10"/>
Aug 08 23:27:02 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:02 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:27:02 user nova-compute[72405]:       <target dev="tap9a42571c-14"/>
Aug 08 23:27:02 user nova-compute[72405]:     </interface>
Aug 08 23:27:02 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:27:02 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/console.log" append="off"/>
Aug 08 23:27:02 user nova-compute[72405]:     </serial>
Aug 08 23:27:02 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:27:02 user nova-compute[72405]:     <video>
Aug 08 23:27:02 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:02 user nova-compute[72405]:     </video>
Aug 08 23:27:02 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:27:02 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:27:02 user nova-compute[72405]:     </rng>
Aug 08 23:27:02 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:27:02 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:27:02 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:27:02 user nova-compute[72405]:     </memballoon>
Aug 08 23:27:02 user nova-compute[72405]:   </devices>
Aug 08 23:27:02 user nova-compute[72405]: </domain>
Aug 08 23:27:02 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1634977089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1634977089',id=5,image_ref='cf1a14f9-b145-4093-b880-ab78abe03a6a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-380907040',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-ozqx2sck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member',shelved_at='2023-08-08T23:24:55.564365',shelved_host='user',shelved_image_id='cf1a14f9-b145-4093-b880-ab78abe03a6a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=16d8b7a1-0c6b-444f-b17c-c64caa2ece8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG os_vif [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a42571c-14, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a42571c-14, col_values=(('external_ids', {'iface-id': '9a42571c-14a5-4457-b5f9-4a1de6ed2d4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:fd:10', 'vm-uuid': '16d8b7a1-0c6b-444f-b17c-c64caa2ece8c'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:27:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:03 user nova-compute[72405]: INFO os_vif [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14')
Aug 08 23:27:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:27:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:27:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No VIF found with MAC fa:16:3e:61:fd:10, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:27:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-8403b202-6371-4d70-b55e-828aac610de7 req-92b6dae2-aa2c-4679-9afe-7ef757cf1b25 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8403b202-6371-4d70-b55e-828aac610de7 req-92b6dae2-aa2c-4679-9afe-7ef757cf1b25 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8403b202-6371-4d70-b55e-828aac610de7 req-92b6dae2-aa2c-4679-9afe-7ef757cf1b25 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8403b202-6371-4d70-b55e-828aac610de7 req-92b6dae2-aa2c-4679-9afe-7ef757cf1b25 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-8403b202-6371-4d70-b55e-828aac610de7 req-92b6dae2-aa2c-4679-9afe-7ef757cf1b25 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:05 user nova-compute[72405]: WARNING nova.compute.manager [req-8403b202-6371-4d70-b55e-828aac610de7 req-92b6dae2-aa2c-4679-9afe-7ef757cf1b25 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 08 23:27:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-9468bb19-0b1d-4479-a21f-77d5fe37c6d0 req-92d057a3-0df2-4e18-907a-23bf758f969d service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9468bb19-0b1d-4479-a21f-77d5fe37c6d0 req-92d057a3-0df2-4e18-907a-23bf758f969d service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9468bb19-0b1d-4479-a21f-77d5fe37c6d0 req-92d057a3-0df2-4e18-907a-23bf758f969d service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9468bb19-0b1d-4479-a21f-77d5fe37c6d0 req-92d057a3-0df2-4e18-907a-23bf758f969d service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-9468bb19-0b1d-4479-a21f-77d5fe37c6d0 req-92d057a3-0df2-4e18-907a-23bf758f969d service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:07 user nova-compute[72405]: WARNING nova.compute.manager [req-9468bb19-0b1d-4479-a21f-77d5fe37c6d0 req-92d057a3-0df2-4e18-907a-23bf758f969d service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537227.3423028, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:07 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] VM Resumed (Lifecycle Event)
Aug 08 23:27:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance spawned successfully.
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:27:07 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537227.3428388, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:07 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] VM Started (Lifecycle Event)
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:27:07 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:27:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d3e17f98-4a67-4468-a3e2-34e8f92a6cdc tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.371s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:10 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537215.3190694, 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:10 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] VM Stopped (Lifecycle Event)
Aug 08 23:27:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-51aea762-bc4c-4e94-b470-f55121080ab7 None None] [instance: 4efaaaf8-fcb6-408b-9374-e6dcdd2adaec] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:15 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537220.4170125, 760574b8-2c65-4bb3-9ea6-1462bd32774b => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:15 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] VM Stopped (Lifecycle Event)
Aug 08 23:27:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f767cca0-ef53-48b1-8fe9-54bc90885213 None None] [instance: 760574b8-2c65-4bb3-9ea6-1462bd32774b] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:22 user nova-compute[72405]: INFO nova.compute.manager [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Terminating instance
Aug 08 23:27:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-0854b939-93a7-43bc-a0e8-d8647c7539ed req-4de0d905-761d-406e-a494-aedbaef6c3a0 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-unplugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0854b939-93a7-43bc-a0e8-d8647c7539ed req-4de0d905-761d-406e-a494-aedbaef6c3a0 service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0854b939-93a7-43bc-a0e8-d8647c7539ed req-4de0d905-761d-406e-a494-aedbaef6c3a0 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0854b939-93a7-43bc-a0e8-d8647c7539ed req-4de0d905-761d-406e-a494-aedbaef6c3a0 service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-0854b939-93a7-43bc-a0e8-d8647c7539ed req-4de0d905-761d-406e-a494-aedbaef6c3a0 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-unplugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-0854b939-93a7-43bc-a0e8-d8647c7539ed req-4de0d905-761d-406e-a494-aedbaef6c3a0 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-unplugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:27:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Instance destroyed successfully.
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.objects.instance [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lazy-loading 'resources' on Instance uuid 330c761e-bda2-45ac-8731-fe511b40624c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1614868477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-674469148',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2/Tv+b0uztkXHMREr0UP8T0i6R/8JrjK1hb5/JEax3JDtvpPQmo4hkEAoigmfGRTl79Pw59QXqqVHqBZYXTbZQ9o/acWpERhf3mjn3D88m8ZJHZVoYA1j9Wo3IojtHjw==',key_name='tempest-keypair-861392922',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:26:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21f0a5ebefd74f72810befd87bf0555e',ramdisk_id='',reservation_id='r-wzbbfqxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1828337581',owner_user_name='tempest-ServerActionsV293TestJSON-1828337581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0bf5d8840da4cf6b94c2b86218e56b2',uuid=330c761e-bda2-45ac-8731-fe511b40624c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converting VIF {"id": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "address": "fa:16:3e:dd:bb:19", "network": {"id": "953c3e37-7e19-44c3-8e6b-c395d0bda02f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1519886783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f0a5ebefd74f72810befd87bf0555e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7b490f-5f", "ovs_interfaceid": "9b7b490f-5f0c-4df2-b016-5f494f3b0b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_vif [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b7b490f-5f, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:23 user nova-compute[72405]: INFO os_vif [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bb:19,bridge_name='br-int',has_traffic_filtering=True,id=9b7b490f-5f0c-4df2-b016-5f494f3b0b3a,network=Network(953c3e37-7e19-44c3-8e6b-c395d0bda02f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7b490f-5f')
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaSuXHCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:27:23 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[013cd1fe-f875-40a0-9677-02ad0e78b078]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[187baf61-3053-4b01-b165-adc819f8a3b0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781baef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f7af24-b50d-4782-87dd-e8e9431ce977]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac07e5-9aa6-435f-8e5c-e198050ec915]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[96865820-4a01-4660-85e1-3de57d5c5b51]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30b5cc1-21f1-4818-bde3-d8570fffce0b]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5b224cf',) {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:27:23 user nova-compute[72405]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f5b224cf
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa7e86-d9d0-4533-933f-1d9f3969e4a4]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c715e6c4-f87b-471a-927c-2baba7b48f50]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff76c8b9-e1c5-4497-8888-c02ae3f89f68]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260]
Aug 08 23:27:23 user nova-compute[72405]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5, portal: 172.16.0.220,3260] successful.
Aug 08 23:27:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71eafcd6-2945-46a2-b22c-7e20d018c7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4380f0-6ad5-4e1a-af0b-acda4dfb23a2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] <== disconnect_volume: return (405ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:27:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Deleting instance files /opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c_del
Aug 08 23:27:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Deletion of /opt/stack/data/nova/instances/330c761e-bda2-45ac-8731-fe511b40624c_del complete
Aug 08 23:27:23 user nova-compute[72405]: INFO nova.compute.manager [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 08 23:27:23 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:27:23 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:27:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-8fdadda7-c068-403a-902d-950f7144a1cf req-a3613046-d325-441e-a2b0-312a8871f26d service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8fdadda7-c068-403a-902d-950f7144a1cf req-a3613046-d325-441e-a2b0-312a8871f26d service nova] Acquiring lock "330c761e-bda2-45ac-8731-fe511b40624c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8fdadda7-c068-403a-902d-950f7144a1cf req-a3613046-d325-441e-a2b0-312a8871f26d service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8fdadda7-c068-403a-902d-950f7144a1cf req-a3613046-d325-441e-a2b0-312a8871f26d service nova] Lock "330c761e-bda2-45ac-8731-fe511b40624c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-8fdadda7-c068-403a-902d-950f7144a1cf req-a3613046-d325-441e-a2b0-312a8871f26d service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] No waiting events found dispatching network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:25 user nova-compute[72405]: WARNING nova.compute.manager [req-8fdadda7-c068-403a-902d-950f7144a1cf req-a3613046-d325-441e-a2b0-312a8871f26d service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received unexpected event network-vif-plugged-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a for instance with vm_state active and task_state deleting.
Aug 08 23:27:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:27:26 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:26 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Took 2.37 seconds to deallocate network for instance.
Aug 08 23:27:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-0d0558c9-3fb5-47d2-958d-74cda5737470 req-2e160f4b-6b26-48d1-99c0-72afbd7686e3 service nova] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Received event network-vif-deleted-9b7b490f-5f0c-4df2-b016-5f494f3b0b3a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:27 user nova-compute[72405]: INFO nova.compute.manager [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Took 0.86 seconds to detach 1 volumes for instance.
Aug 08 23:27:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Deleting volume: 71eafcd6-2945-46a2-b22c-7e20d018c7a5 {{(pid=72405) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 08 23:27:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:27 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:27:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:27:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:27 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Deleted allocations for instance 330c761e-bda2-45ac-8731-fe511b40624c
Aug 08 23:27:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-05b072ec-7d4c-452a-9b8e-dc02b426085a tempest-ServerActionsV293TestJSON-1828337581 tempest-ServerActionsV293TestJSON-1828337581-project-member] Lock "330c761e-bda2-45ac-8731-fe511b40624c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.300s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:27:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:27:30 user nova-compute[72405]: INFO nova.compute.manager [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Rescuing
Aug 08 23:27:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [{"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-40aa67f5-7c4d-4b60-bc1f-87248edf0f58 req-6631d0f0-3142-40a2-9798-d6844df7bc38 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-40aa67f5-7c4d-4b60-bc1f-87248edf0f58 req-6631d0f0-3142-40a2-9798-d6844df7bc38 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-40aa67f5-7c4d-4b60-bc1f-87248edf0f58 req-6631d0f0-3142-40a2-9798-d6844df7bc38 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-40aa67f5-7c4d-4b60-bc1f-87248edf0f58 req-6631d0f0-3142-40a2-9798-d6844df7bc38 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-40aa67f5-7c4d-4b60-bc1f-87248edf0f58 req-6631d0f0-3142-40a2-9798-d6844df7bc38 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:32 user nova-compute[72405]: WARNING nova.compute.manager [req-40aa67f5-7c4d-4b60-bc1f-87248edf0f58 req-6631d0f0-3142-40a2-9798-d6844df7bc38 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state rescuing.
Aug 08 23:27:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance destroyed successfully.
Aug 08 23:27:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Attempting a stable device rescue
Aug 08 23:27:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72405) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:27:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Creating image(s)
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "/opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG nova.objects.instance [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "e1f13e65b20d6f708730ded5c226d8e0bdde5cfd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e1f13e65b20d6f708730ded5c226d8e0bdde5cfd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.part --force-share --output=json" returned: 0 in 0.172s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG nova.virt.images [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] cdf76b16-3b5d-4112-8e20-9282e769bcd9 was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.part /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.part /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.converted" returned: 0 in 0.530s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-815fe81c-2668-4ad3-8470-e0eb4c7965e7 req-0d15fa71-02fc-4c5a-8cfa-ea0243c714a0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-815fe81c-2668-4ad3-8470-e0eb4c7965e7 req-0d15fa71-02fc-4c5a-8cfa-ea0243c714a0 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-815fe81c-2668-4ad3-8470-e0eb4c7965e7 req-0d15fa71-02fc-4c5a-8cfa-ea0243c714a0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-815fe81c-2668-4ad3-8470-e0eb4c7965e7 req-0d15fa71-02fc-4c5a-8cfa-ea0243c714a0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-815fe81c-2668-4ad3-8470-e0eb4c7965e7 req-0d15fa71-02fc-4c5a-8cfa-ea0243c714a0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:34 user nova-compute[72405]: WARNING nova.compute.manager [req-815fe81c-2668-4ad3-8470-e0eb4c7965e7 req-0d15fa71-02fc-4c5a-8cfa-ea0243c714a0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state rescuing.
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e1f13e65b20d6f708730ded5c226d8e0bdde5cfd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.943s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "e1f13e65b20d6f708730ded5c226d8e0bdde5cfd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e1f13e65b20d6f708730ded5c226d8e0bdde5cfd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd --force-share --output=json" returned: 0 in 0.197s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd,backing_fmt=raw /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd,backing_fmt=raw /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue" returned: 0 in 0.054s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e1f13e65b20d6f708730ded5c226d8e0bdde5cfd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'migration_context' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Start _get_guest_xml network_info=[{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "vif_mac": "fa:16:3e:52:c2:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cdf76b16-3b5d-4112-8e20-9282e769bcd9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea67322b-d63c-44fe-9ce4-f7ec402cd669', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2adde477-61ea-4f06-a71d-86a3d94902f2', 'attached_at': '', 'detached_at': '', 'volume_id': '22783579-94d2-4c13-b34a-b324335d69d2', 'serial': '22783579-94d2-4c13-b34a-b324335d69d2'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'resources' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'numa_topology' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:34 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:27:34 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:27:34 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:27:34 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b3bd2-2c64-411f-a6ae-8cdc6be1bfb2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GAxJkVXU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 08 23:27:34 user nova-compute[72405]: node.name = iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2
Aug 08 23:27:34 user nova-compute[72405]: node.tpgt = -1
Aug 08 23:27:34 user nova-compute[72405]: node.startup = automatic
Aug 08 23:27:34 user nova-compute[72405]: node.leading_login = No
Aug 08 23:27:34 user nova-compute[72405]: iface.iscsi_ifacename = default
Aug 08 23:27:34 user nova-compute[72405]: iface.net_ifacename = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.ipaddress = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.prefix_len = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.hwaddress = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.transport_name = tcp
Aug 08 23:27:34 user nova-compute[72405]: iface.initiatorname = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.vlan_id = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.vlan_priority = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.vlan_state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.iface_num = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.mtu = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.port = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.bootproto = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.subnet_mask = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.gateway = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_alt_client_id_state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_alt_client_id = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_dns = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_learn_iqn = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_req_vendor_id_state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_vendor_id_state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_vendor_id = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.dhcp_slp_da = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.fragmentation = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.gratuitous_arp = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.incoming_forwarding = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.tos_state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.tos = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.ttl = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.delayed_ack = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.tcp_nagle = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.tcp_wsf_state = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.tcp_wsf = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.tcp_timer_scale = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.tcp_timestamp = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.redirect = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.def_task_mgmt_timeout = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.header_digest = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.data_digest = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.immediate_data = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.initial_r2t = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.data_seq_inorder = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.data_pdu_inorder = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.erl = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.max_receive_data_len = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.first_burst_len = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.max_outstanding_r2t = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.max_burst_len = 0
Aug 08 23:27:34 user nova-compute[72405]: iface.chap_auth = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.bidi_chap = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.strict_login_compliance = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.discovery_auth = <empty>
Aug 08 23:27:34 user nova-compute[72405]: iface.discovery_logout = <empty>
Aug 08 23:27:34 user nova-compute[72405]: node.discovery_address = <empty>
Aug 08 23:27:34 user nova-compute[72405]: node.discovery_port = 0
Aug 08 23:27:34 user nova-compute[72405]: node.discovery_type = static
Aug 08 23:27:34 user nova-compute[72405]: node.session.initial_cmdsn = 0
Aug 08 23:27:34 user nova-compute[72405]: node.session.initial_login_retry_max = 8
Aug 08 23:27:34 user nova-compute[72405]: node.session.xmit_thread_priority = -20
Aug 08 23:27:34 user nova-compute[72405]: node.session.cmds_max = 128
Aug 08 23:27:34 user nova-compute[72405]: node.session.queue_depth = 32
Aug 08 23:27:34 user nova-compute[72405]: node.session.nr_sessions = 1
Aug 08 23:27:34 user nova-compute[72405]: node.session.auth.authmethod = CHAP
Aug 08 23:27:34 user nova-compute[72405]: node.session.auth.username = GAxJkVXU
Aug 08 23:27:34 user nova-compute[72405]: node.session.auth.password = ***
Aug 08 23:27:34 user nova-compute[72405]: node.session.auth.username_in = <empty>
Aug 08 23:27:34 user nova-compute[72405]: node.session.auth.password_in = <empty>
Aug 08 23:27:34 user nova-compute[72405]: node.session.auth.chap_algs = MD5
Aug 08 23:27:34 user nova-compute[72405]: node.session.timeo.replacement_timeout = 120
Aug 08 23:27:34 user nova-compute[72405]: node.session.err_timeo.abort_timeout = 15
Aug 08 23:27:34 user nova-compute[72405]: node.session.err_timeo.lu_reset_timeout = 30
Aug 08 23:27:34 user nova-compute[72405]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 08 23:27:34 user nova-compute[72405]: node.session.err_timeo.host_reset_timeout = 60
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.FastAbort = Yes
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.InitialR2T = No
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.ImmediateData = Yes
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.FirstBurstLength = 262144
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.MaxBurstLength = 16776192
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.DefaultTime2Retain = 0
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.DefaultTime2Wait = 2
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.MaxConnections = 1
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 08 23:27:34 user nova-compute[72405]: node.session.iscsi.ERL = 0
Aug 08 23:27:34 user nova-compute[72405]: node.session.scan = manual
Aug 08 23:27:34 user nova-compute[72405]: node.session.reopen_max = 0
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].address = 172.16.0.220
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].port = 3260
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].startup = manual
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].tcp.window_size = 524288
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].tcp.type_of_service = 0
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].timeo.logout_timeout = 15
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].timeo.login_timeout = 15
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].timeo.auth_timeout = 45
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].timeo.noop_out_interval = 5
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].timeo.noop_out_timeout = 5
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].iscsi.HeaderDigest = None
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].iscsi.DataDigest = None
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].iscsi.IFMarker = No
Aug 08 23:27:34 user nova-compute[72405]: node.conn[0].iscsi.OFMarker = No
Aug 08 23:27:34 user nova-compute[72405]: # END RECORD
Aug 08 23:27:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef415f2-e835-4a7c-89a8-e0ddf2c622e3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[86400229-3b5f-4dcd-9cd6-b087bc22ec07]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAxJkVXU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAxJkVXU" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a6599b-752c-4bb1-9c90-39be617e18fc]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GAxJkVXU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffd3b9d-bb01-4cd5-9d55-65d1039e71a3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042aaa4-82dc-4382-b331-967dc90fa99b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:35 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:35 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:35 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:35 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:35 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:35 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:35 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:35 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de845032-7846-4f68-ae6d-41316388c348]: (4, ('0 0 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.261s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== connect_volume: return (263ms) {'type': 'block', 'scsi_wwn': '23663653964376135', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663653964376135', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743707640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743707640',id=14,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:26:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-qbho4jw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:26:07Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=2adde477-61ea-4f06-a71d-86a3d94902f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "vif_mac": "fa:16:3e:52:c2:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "vif_mac": "fa:16:3e:52:c2:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'pci_devices' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:27:35 user nova-compute[72405]:   <uuid>2adde477-61ea-4f06-a71d-86a3d94902f2</uuid>
Aug 08 23:27:35 user nova-compute[72405]:   <name>instance-0000000e</name>
Aug 08 23:27:35 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:27:35 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:27:35 user nova-compute[72405]:   <metadata>
Aug 08 23:27:35 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:27:35 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:27:35 user nova-compute[72405]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1743707640</nova:name>
Aug 08 23:27:35 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:27:34</nova:creationTime>
Aug 08 23:27:35 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:27:35 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:27:35 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:27:35 user nova-compute[72405]:       <nova:owner>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:user uuid="d9b5279220af4cc4a364014419168ae8">tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member</nova:user>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:project uuid="1bf26de781ef4462914d7f32168b3192">tempest-ServerBootFromVolumeStableRescueTest-1549652719</nova:project>
Aug 08 23:27:35 user nova-compute[72405]:       </nova:owner>
Aug 08 23:27:35 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:27:35 user nova-compute[72405]:       <nova:ports>
Aug 08 23:27:35 user nova-compute[72405]:         <nova:port uuid="b92a56a7-a14c-479f-852d-f8308c418daf">
Aug 08 23:27:35 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 08 23:27:35 user nova-compute[72405]:         </nova:port>
Aug 08 23:27:35 user nova-compute[72405]:       </nova:ports>
Aug 08 23:27:35 user nova-compute[72405]:     </nova:instance>
Aug 08 23:27:35 user nova-compute[72405]:   </metadata>
Aug 08 23:27:35 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:27:35 user nova-compute[72405]:     <system>
Aug 08 23:27:35 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:27:35 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:27:35 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:27:35 user nova-compute[72405]:       <entry name="serial">2adde477-61ea-4f06-a71d-86a3d94902f2</entry>
Aug 08 23:27:35 user nova-compute[72405]:       <entry name="uuid">2adde477-61ea-4f06-a71d-86a3d94902f2</entry>
Aug 08 23:27:35 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:27:35 user nova-compute[72405]:     </system>
Aug 08 23:27:35 user nova-compute[72405]:   </sysinfo>
Aug 08 23:27:35 user nova-compute[72405]:   <os>
Aug 08 23:27:35 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:27:35 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:27:35 user nova-compute[72405]:   </os>
Aug 08 23:27:35 user nova-compute[72405]:   <features>
Aug 08 23:27:35 user nova-compute[72405]:     <acpi/>
Aug 08 23:27:35 user nova-compute[72405]:     <apic/>
Aug 08 23:27:35 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:27:35 user nova-compute[72405]:   </features>
Aug 08 23:27:35 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:27:35 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:27:35 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:27:35 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:27:35 user nova-compute[72405]:   </clock>
Aug 08 23:27:35 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:27:35 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:27:35 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:27:35 user nova-compute[72405]:   </cpu>
Aug 08 23:27:35 user nova-compute[72405]:   <devices>
Aug 08 23:27:35 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:27:35 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:27:35 user nova-compute[72405]:       <source dev="/dev/sdc"/>
Aug 08 23:27:35 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:27:35 user nova-compute[72405]:       <serial>22783579-94d2-4c13-b34a-b324335d69d2</serial>
Aug 08 23:27:35 user nova-compute[72405]:     </disk>
Aug 08 23:27:35 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:27:35 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:27:35 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue"/>
Aug 08 23:27:35 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:27:35 user nova-compute[72405]:       <boot order="1"/>
Aug 08 23:27:35 user nova-compute[72405]:     </disk>
Aug 08 23:27:35 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:27:35 user nova-compute[72405]:       <mac address="fa:16:3e:52:c2:72"/>
Aug 08 23:27:35 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:35 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:27:35 user nova-compute[72405]:       <target dev="tapb92a56a7-a1"/>
Aug 08 23:27:35 user nova-compute[72405]:     </interface>
Aug 08 23:27:35 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:27:35 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/console.log" append="off"/>
Aug 08 23:27:35 user nova-compute[72405]:     </serial>
Aug 08 23:27:35 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:27:35 user nova-compute[72405]:     <video>
Aug 08 23:27:35 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:35 user nova-compute[72405]:     </video>
Aug 08 23:27:35 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:27:35 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:27:35 user nova-compute[72405]:     </rng>
Aug 08 23:27:35 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:27:35 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:27:35 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:27:35 user nova-compute[72405]:     </memballoon>
Aug 08 23:27:35 user nova-compute[72405]:   </devices>
Aug 08 23:27:35 user nova-compute[72405]: </domain>
Aug 08 23:27:35 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance destroyed successfully.
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No VIF found with MAC fa:16:3e:52:c2:72, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537243.3202043, 330c761e-bda2-45ac-8731-fe511b40624c => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:39 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] VM Stopped (Lifecycle Event)
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 2adde477-61ea-4f06-a71d-86a3d94902f2 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537259.538389, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:39 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Resumed (Lifecycle Event)
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-aba76358-9c64-49cf-aaa1-fc219d2d72ca req-5f181095-4a6c-4046-8acb-0bb1028e6ad4 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aba76358-9c64-49cf-aaa1-fc219d2d72ca req-5f181095-4a6c-4046-8acb-0bb1028e6ad4 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aba76358-9c64-49cf-aaa1-fc219d2d72ca req-5f181095-4a6c-4046-8acb-0bb1028e6ad4 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aba76358-9c64-49cf-aaa1-fc219d2d72ca req-5f181095-4a6c-4046-8acb-0bb1028e6ad4 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-aba76358-9c64-49cf-aaa1-fc219d2d72ca req-5f181095-4a6c-4046-8acb-0bb1028e6ad4 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:39 user nova-compute[72405]: WARNING nova.compute.manager [req-aba76358-9c64-49cf-aaa1-fc219d2d72ca req-5f181095-4a6c-4046-8acb-0bb1028e6ad4 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state rescuing.
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-2c574cbf-4987-4f5f-a414-36c429e9ea1f req-d2ce2a10-37b5-4551-86cb-1b5b9dced724 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2c574cbf-4987-4f5f-a414-36c429e9ea1f req-d2ce2a10-37b5-4551-86cb-1b5b9dced724 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2c574cbf-4987-4f5f-a414-36c429e9ea1f req-d2ce2a10-37b5-4551-86cb-1b5b9dced724 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2c574cbf-4987-4f5f-a414-36c429e9ea1f req-d2ce2a10-37b5-4551-86cb-1b5b9dced724 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-2c574cbf-4987-4f5f-a414-36c429e9ea1f req-d2ce2a10-37b5-4551-86cb-1b5b9dced724 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:39 user nova-compute[72405]: WARNING nova.compute.manager [req-2c574cbf-4987-4f5f-a414-36c429e9ea1f req-d2ce2a10-37b5-4551-86cb-1b5b9dced724 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state rescuing.
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-96df31e2-b79f-41be-a0ef-954352517a0c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:27:39 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:39 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.611347198486328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8039c687-5087-4f35-a61c-9b6b5f6b0c4b None None] [instance: 330c761e-bda2-45ac-8731-fe511b40624c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:27:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:27:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537259.5391796, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Started (Lifecycle Event)
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 51cd87b7-e26e-4bb0-9b07-8f22e3244935 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance c3e19ae0-d188-4ed4-80f1-569c5785f5e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.368s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:27:40 user nova-compute[72405]: INFO nova.compute.claims [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Claim successful on node user
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:27:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:27:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Creating image(s)
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.policy [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fced4d4747e4e3abb0772b956bedba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7781e7654e447fb13a10725e45a2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.177s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk 1073741824" returned: 0 in 0.056s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Cannot resize image /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'migration_context' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Ensure instance console log exists: /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Successfully created port: f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:27:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Successfully updated port: f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-changed-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Refreshing instance network info cache due to event network-changed-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance network_info: |[{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Refreshing network info cache for port f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start _get_guest_xml network_info=[{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:27:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:27:44 user nova-compute[72405]:   <uuid>9f105082-c7cc-4b7d-b6d4-04a293e832cf</uuid>
Aug 08 23:27:44 user nova-compute[72405]:   <name>instance-00000011</name>
Aug 08 23:27:44 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:27:44 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:27:44 user nova-compute[72405]:   <metadata>
Aug 08 23:27:44 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:27:44 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:27:44 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherB-server-1050796295</nova:name>
Aug 08 23:27:44 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:27:44</nova:creationTime>
Aug 08 23:27:44 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:27:44 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:27:44 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:27:44 user nova-compute[72405]:       <nova:owner>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:user uuid="1fced4d4747e4e3abb0772b956bedba7">tempest-ServerActionsTestOtherB-1153417891-project-member</nova:user>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:project uuid="af7781e7654e447fb13a10725e45a2fe">tempest-ServerActionsTestOtherB-1153417891</nova:project>
Aug 08 23:27:44 user nova-compute[72405]:       </nova:owner>
Aug 08 23:27:44 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:27:44 user nova-compute[72405]:       <nova:ports>
Aug 08 23:27:44 user nova-compute[72405]:         <nova:port uuid="f9f2e3cc-1e64-475b-9e4a-f1a0db25b771">
Aug 08 23:27:44 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:27:44 user nova-compute[72405]:         </nova:port>
Aug 08 23:27:44 user nova-compute[72405]:       </nova:ports>
Aug 08 23:27:44 user nova-compute[72405]:     </nova:instance>
Aug 08 23:27:44 user nova-compute[72405]:   </metadata>
Aug 08 23:27:44 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:27:44 user nova-compute[72405]:     <system>
Aug 08 23:27:44 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:27:44 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:27:44 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:27:44 user nova-compute[72405]:       <entry name="serial">9f105082-c7cc-4b7d-b6d4-04a293e832cf</entry>
Aug 08 23:27:44 user nova-compute[72405]:       <entry name="uuid">9f105082-c7cc-4b7d-b6d4-04a293e832cf</entry>
Aug 08 23:27:44 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:27:44 user nova-compute[72405]:     </system>
Aug 08 23:27:44 user nova-compute[72405]:   </sysinfo>
Aug 08 23:27:44 user nova-compute[72405]:   <os>
Aug 08 23:27:44 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:27:44 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:27:44 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:27:44 user nova-compute[72405]:   </os>
Aug 08 23:27:44 user nova-compute[72405]:   <features>
Aug 08 23:27:44 user nova-compute[72405]:     <acpi/>
Aug 08 23:27:44 user nova-compute[72405]:     <apic/>
Aug 08 23:27:44 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:27:44 user nova-compute[72405]:   </features>
Aug 08 23:27:44 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:27:44 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:27:44 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:27:44 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:27:44 user nova-compute[72405]:   </clock>
Aug 08 23:27:44 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:27:44 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:27:44 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:27:44 user nova-compute[72405]:   </cpu>
Aug 08 23:27:44 user nova-compute[72405]:   <devices>
Aug 08 23:27:44 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:27:44 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:27:44 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk"/>
Aug 08 23:27:44 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:27:44 user nova-compute[72405]:     </disk>
Aug 08 23:27:44 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:27:44 user nova-compute[72405]:       <mac address="fa:16:3e:2f:cf:a3"/>
Aug 08 23:27:44 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:44 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:27:44 user nova-compute[72405]:       <target dev="tapf9f2e3cc-1e"/>
Aug 08 23:27:44 user nova-compute[72405]:     </interface>
Aug 08 23:27:44 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:27:44 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/console.log" append="off"/>
Aug 08 23:27:44 user nova-compute[72405]:     </serial>
Aug 08 23:27:44 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:27:44 user nova-compute[72405]:     <video>
Aug 08 23:27:44 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:44 user nova-compute[72405]:     </video>
Aug 08 23:27:44 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:27:44 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:27:44 user nova-compute[72405]:     </rng>
Aug 08 23:27:44 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:27:44 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:27:44 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:27:44 user nova-compute[72405]:     </memballoon>
Aug 08 23:27:44 user nova-compute[72405]:   </devices>
Aug 08 23:27:44 user nova-compute[72405]: </domain>
Aug 08 23:27:44 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG os_vif [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9f2e3cc-1e, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9f2e3cc-1e, col_values=(('external_ids', {'iface-id': 'f9f2e3cc-1e64-475b-9e4a-f1a0db25b771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:cf:a3', 'vm-uuid': '9f105082-c7cc-4b7d-b6d4-04a293e832cf'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:27:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:44 user nova-compute[72405]: INFO os_vif [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e')
Aug 08 23:27:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:27:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No VIF found with MAC fa:16:3e:2f:cf:a3, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:27:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updated VIF entry in instance network info cache for port f9f2e3cc-1e64-475b-9e4a-f1a0db25b771. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:27:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-46387083-8980-4c42-a0ef-ef94e2b9eb77 req-09cedecb-1247-4fe7-8af6-656eb025575a service nova] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:46 user nova-compute[72405]: INFO nova.compute.manager [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Detaching volume 3a9566b9-bcbc-4249-9be8-6e311e5e4348
Aug 08 23:27:46 user nova-compute[72405]: INFO nova.virt.block_device [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Attempting to driver detach volume 3a9566b9-bcbc-4249-9be8-6e311e5e4348 from mountpoint /dev/vdb
Aug 08 23:27:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Attempting to detach device vdb from instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:27:46 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:27:46 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:27:46 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:27:46 user nova-compute[72405]:   <serial>3a9566b9-bcbc-4249-9be8-6e311e5e4348</serial>
Aug 08 23:27:46 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:27:46 user nova-compute[72405]: </disk>
Aug 08 23:27:46 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:27:46 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully detached device vdb from instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 from the persistent domain config.
Aug 08 23:27:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:27:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:27:46 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:27:46 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:27:46 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:27:46 user nova-compute[72405]:   <serial>3a9566b9-bcbc-4249-9be8-6e311e5e4348</serial>
Aug 08 23:27:46 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:27:46 user nova-compute[72405]: </disk>
Aug 08 23:27:46 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-b09acaac-4c7a-4ff4-a2ca-d9becbb59cef req-97ea686d-a981-4760-a62a-a629902b5caf service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b09acaac-4c7a-4ff4-a2ca-d9becbb59cef req-97ea686d-a981-4760-a62a-a629902b5caf service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b09acaac-4c7a-4ff4-a2ca-d9becbb59cef req-97ea686d-a981-4760-a62a-a629902b5caf service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b09acaac-4c7a-4ff4-a2ca-d9becbb59cef req-97ea686d-a981-4760-a62a-a629902b5caf service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-b09acaac-4c7a-4ff4-a2ca-d9becbb59cef req-97ea686d-a981-4760-a62a-a629902b5caf service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:47 user nova-compute[72405]: WARNING nova.compute.manager [req-b09acaac-4c7a-4ff4-a2ca-d9becbb59cef req-97ea686d-a981-4760-a62a-a629902b5caf service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state building and task_state spawning.
Aug 08 23:27:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537267.2272234, 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:27:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully detached device vdb from instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 from the live domain config.
Aug 08 23:27:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVEhemKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:27:47 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ce9a7-33c3-479a-ab03-ca91bcd6df7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[34865de4-191a-4f32-9acc-4858238a45d7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:47 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:47 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:47 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:27:47 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:27:47 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:27:47 user nova-compute[72405]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 (non-flash)
Aug 08 23:27:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7d33760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348'): ({'sdg'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Removing single pathed devices sdg {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9539748-2bca-4dbe-8331-d92fc72b4b08]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[80da1e95-c553-4bc4-9816-254a4166d275]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flushing IO for device /dev/sdg {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aca559-c350-400a-9659-d8cb216b7c1d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0cfb1e-400c-4adc-86d4-33988b423a69]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[439265d1-6f9b-420b-bca6-c628a86c8da5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bead6797-c92e-48ee-9551-3bf7da50f9b0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260]
Aug 08 23:27:47 user nova-compute[72405]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348, portal: 172.16.0.220,3260] successful.
Aug 08 23:27:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9566b9-bcbc-4249-9be8-6e311e5e4348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[27535806-c5b6-41b5-8b33-6b7608411d63]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== disconnect_volume: return (361ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:27:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:27:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:48 user nova-compute[72405]: DEBUG nova.objects.instance [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25241a38-81cf-4008-b3df-7f3a0b1c9cfe tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.044s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537269.1016757, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Resumed (Lifecycle Event)
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance spawned successfully.
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-f30be13d-97fa-48bc-abc4-593da0ea42a2 req-aab46133-c3cb-41e1-8747-72e64c0ee57f service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f30be13d-97fa-48bc-abc4-593da0ea42a2 req-aab46133-c3cb-41e1-8747-72e64c0ee57f service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f30be13d-97fa-48bc-abc4-593da0ea42a2 req-aab46133-c3cb-41e1-8747-72e64c0ee57f service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f30be13d-97fa-48bc-abc4-593da0ea42a2 req-aab46133-c3cb-41e1-8747-72e64c0ee57f service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-f30be13d-97fa-48bc-abc4-593da0ea42a2 req-aab46133-c3cb-41e1-8747-72e64c0ee57f service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:27:49 user nova-compute[72405]: WARNING nova.compute.manager [req-f30be13d-97fa-48bc-abc4-593da0ea42a2 req-aab46133-c3cb-41e1-8747-72e64c0ee57f service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state building and task_state spawning.
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537269.1083846, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Started (Lifecycle Event)
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Took 8.22 seconds to spawn the instance on the hypervisor.
Aug 08 23:27:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:27:49 user nova-compute[72405]: INFO nova.compute.manager [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Took 9.44 seconds to build instance.
Aug 08 23:27:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-20d24cd2-b55e-4399-980a-c620a83410d3 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.779s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:27:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:27:52 user nova-compute[72405]: INFO nova.compute.claims [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Claim successful on node user
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:27:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:27:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:27:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Creating image(s)
Aug 08 23:27:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.policy [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24b44561b1d9485b845bc9157be71736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c875dc671b18444089e28d84beeb4bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.206s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.191s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk 1073741824" returned: 0 in 0.061s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:27:54 user nova-compute[72405]: INFO nova.compute.claims [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Claim successful on node user
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Cannot resize image /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'migration_context' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Ensure instance console log exists: /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:54 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:27:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:27:55 user nova-compute[72405]: INFO nova.virt.block_device [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Booting with volume bf353614-3578-4b1c-a636-15a160b4a834 at /dev/vda
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.policy [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e3c4d0e349b49f0ac2151b1bcb1af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d232f86412044a58663caf23a71cc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG os_brick.utils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0198a406-09c3-4ff8-906f-d84b6ac341d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a63de-ea62-485d-b528-8363f5c1925a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0706e45-e687-4a23-9ee2-e079aebddc85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc10daa-74fc-4fa8-ae5a-1ba69d55ab70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:27:55 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:27:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f8aeaf-9067-423a-a0e3-7f091110a5fd]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG os_brick.utils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating existing volume attachment record: 8cb0b083-fb68-48bf-a788-3ac134b00dd8 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Successfully created port: 7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:27:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Successfully created port: 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Successfully updated port: 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing instance network info cache due to event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance network_info: |[{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Successfully updated port: 7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing instance network info cache due to event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:27:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updated VIF entry in instance network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3ba0a188-a5b5-45c3-a3d2-ff188cb0af58 req-26f75d2a-f70a-4fce-b6c3-7840d74b717e service nova] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance network_info: |[{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Start _get_guest_xml network_info=[{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:27:58 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:58 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-452517066',display_name='tempest-ServerStableDeviceRescueTest-server-452517066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-452517066',id=18,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfb+9WmRPUuJID0aCtCuVWP3Y5xAGVKgUgc8vQE5Us4fml62cTBVbJ8SSWaqHZPlj6Uxq5guWwS0hwOkGccO0dH9ecgls3SF6jBVEpegRCE66dlBdrvcMqOKvzV/wvbHQ==',key_name='tempest-keypair-2083609225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c875dc671b18444089e28d84beeb4bb4',ramdisk_id='',reservation_id='r-2xadwtvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-405578644',owner_user_name='tempest-ServerStableDeviceRescueTest-405578644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24b44561b1d9485b845bc9157be71736',uuid=f7fccdf2-d173-42c4-9c04-421e7dfe6ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converting VIF {"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'pci_devices' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:27:58 user nova-compute[72405]:   <uuid>f7fccdf2-d173-42c4-9c04-421e7dfe6ef0</uuid>
Aug 08 23:27:58 user nova-compute[72405]:   <name>instance-00000012</name>
Aug 08 23:27:58 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:27:58 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:27:58 user nova-compute[72405]:   <metadata>
Aug 08 23:27:58 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:27:58 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:27:58 user nova-compute[72405]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-452517066</nova:name>
Aug 08 23:27:58 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:27:58</nova:creationTime>
Aug 08 23:27:58 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:27:58 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:27:58 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:27:58 user nova-compute[72405]:       <nova:owner>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:user uuid="24b44561b1d9485b845bc9157be71736">tempest-ServerStableDeviceRescueTest-405578644-project-member</nova:user>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:project uuid="c875dc671b18444089e28d84beeb4bb4">tempest-ServerStableDeviceRescueTest-405578644</nova:project>
Aug 08 23:27:58 user nova-compute[72405]:       </nova:owner>
Aug 08 23:27:58 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:27:58 user nova-compute[72405]:       <nova:ports>
Aug 08 23:27:58 user nova-compute[72405]:         <nova:port uuid="7f005eac-6485-491f-8fdf-c65a3a2d958e">
Aug 08 23:27:58 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:27:58 user nova-compute[72405]:         </nova:port>
Aug 08 23:27:58 user nova-compute[72405]:       </nova:ports>
Aug 08 23:27:58 user nova-compute[72405]:     </nova:instance>
Aug 08 23:27:58 user nova-compute[72405]:   </metadata>
Aug 08 23:27:58 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:27:58 user nova-compute[72405]:     <system>
Aug 08 23:27:58 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:27:58 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:27:58 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:27:58 user nova-compute[72405]:       <entry name="serial">f7fccdf2-d173-42c4-9c04-421e7dfe6ef0</entry>
Aug 08 23:27:58 user nova-compute[72405]:       <entry name="uuid">f7fccdf2-d173-42c4-9c04-421e7dfe6ef0</entry>
Aug 08 23:27:58 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:27:58 user nova-compute[72405]:     </system>
Aug 08 23:27:58 user nova-compute[72405]:   </sysinfo>
Aug 08 23:27:58 user nova-compute[72405]:   <os>
Aug 08 23:27:58 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:27:58 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:27:58 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:27:58 user nova-compute[72405]:   </os>
Aug 08 23:27:58 user nova-compute[72405]:   <features>
Aug 08 23:27:58 user nova-compute[72405]:     <acpi/>
Aug 08 23:27:58 user nova-compute[72405]:     <apic/>
Aug 08 23:27:58 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:27:58 user nova-compute[72405]:   </features>
Aug 08 23:27:58 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:27:58 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:27:58 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:27:58 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:27:58 user nova-compute[72405]:   </clock>
Aug 08 23:27:58 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:27:58 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:27:58 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:27:58 user nova-compute[72405]:   </cpu>
Aug 08 23:27:58 user nova-compute[72405]:   <devices>
Aug 08 23:27:58 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:27:58 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:27:58 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk"/>
Aug 08 23:27:58 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:27:58 user nova-compute[72405]:     </disk>
Aug 08 23:27:58 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:27:58 user nova-compute[72405]:       <mac address="fa:16:3e:55:12:ff"/>
Aug 08 23:27:58 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:58 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:27:58 user nova-compute[72405]:       <target dev="tap7f005eac-64"/>
Aug 08 23:27:58 user nova-compute[72405]:     </interface>
Aug 08 23:27:58 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:27:58 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/console.log" append="off"/>
Aug 08 23:27:58 user nova-compute[72405]:     </serial>
Aug 08 23:27:58 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:27:58 user nova-compute[72405]:     <video>
Aug 08 23:27:58 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:27:58 user nova-compute[72405]:     </video>
Aug 08 23:27:58 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:27:58 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:27:58 user nova-compute[72405]:     </rng>
Aug 08 23:27:58 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:27:58 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:27:58 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:27:58 user nova-compute[72405]:     </memballoon>
Aug 08 23:27:58 user nova-compute[72405]:   </devices>
Aug 08 23:27:58 user nova-compute[72405]: </domain>
Aug 08 23:27:58 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-452517066',display_name='tempest-ServerStableDeviceRescueTest-server-452517066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-452517066',id=18,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfb+9WmRPUuJID0aCtCuVWP3Y5xAGVKgUgc8vQE5Us4fml62cTBVbJ8SSWaqHZPlj6Uxq5guWwS0hwOkGccO0dH9ecgls3SF6jBVEpegRCE66dlBdrvcMqOKvzV/wvbHQ==',key_name='tempest-keypair-2083609225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c875dc671b18444089e28d84beeb4bb4',ramdisk_id='',reservation_id='r-2xadwtvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-405578644',owner_user_name='tempest-ServerStableDeviceRescueTest-405578644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24b44561b1d9485b845bc9157be71736',uuid=f7fccdf2-d173-42c4-9c04-421e7dfe6ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converting VIF {"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG os_vif [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f005eac-64, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f005eac-64, col_values=(('external_ids', {'iface-id': '7f005eac-6485-491f-8fdf-c65a3a2d958e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:12:ff', 'vm-uuid': 'f7fccdf2-d173-42c4-9c04-421e7dfe6ef0'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:58 user nova-compute[72405]: INFO os_vif [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64')
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No VIF found with MAC fa:16:3e:55:12:ff, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updated VIF entry in instance network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:27:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87c4a034-3850-4bb1-ac4e-d0a58762977f req-ff1a55de-cc24-44a3-be9c-d96234b139ea service nova] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:27:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:27:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG nova.compute.manager [req-4071c285-c260-4abc-9a8c-69a0ea0f8ca7 req-8ada7f24-c091-4973-8d83-ac7d97eeedec service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4071c285-c260-4abc-9a8c-69a0ea0f8ca7 req-8ada7f24-c091-4973-8d83-ac7d97eeedec service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4071c285-c260-4abc-9a8c-69a0ea0f8ca7 req-8ada7f24-c091-4973-8d83-ac7d97eeedec service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4071c285-c260-4abc-9a8c-69a0ea0f8ca7 req-8ada7f24-c091-4973-8d83-ac7d97eeedec service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG nova.compute.manager [req-4071c285-c260-4abc-9a8c-69a0ea0f8ca7 req-8ada7f24-c091-4973-8d83-ac7d97eeedec service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:00 user nova-compute[72405]: WARNING nova.compute.manager [req-4071c285-c260-4abc-9a8c-69a0ea0f8ca7 req-8ada7f24-c091-4973-8d83-ac7d97eeedec service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state building and task_state spawning.
Aug 08 23:28:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-c358ec4f-d684-48bc-9c4e-44c3c012304e req-360ef961-66d1-410f-b801-c8e5fffe1efc service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c358ec4f-d684-48bc-9c4e-44c3c012304e req-360ef961-66d1-410f-b801-c8e5fffe1efc service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c358ec4f-d684-48bc-9c4e-44c3c012304e req-360ef961-66d1-410f-b801-c8e5fffe1efc service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c358ec4f-d684-48bc-9c4e-44c3c012304e req-360ef961-66d1-410f-b801-c8e5fffe1efc service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-c358ec4f-d684-48bc-9c4e-44c3c012304e req-360ef961-66d1-410f-b801-c8e5fffe1efc service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:02 user nova-compute[72405]: WARNING nova.compute.manager [req-c358ec4f-d684-48bc-9c4e-44c3c012304e req-360ef961-66d1-410f-b801-c8e5fffe1efc service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state building and task_state spawning.
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537282.671953, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Resumed (Lifecycle Event)
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance spawned successfully.
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537282.6727493, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Started (Lifecycle Event)
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Took 8.92 seconds to spawn the instance on the hypervisor.
Aug 08 23:28:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:02 user nova-compute[72405]: INFO nova.compute.manager [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Took 10.16 seconds to build instance.
Aug 08 23:28:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f7af9cd-ce05-42fd-9025-c7df12e5dc5c tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.292s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:28:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Creating image(s)
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Ensure instance console log exists: /opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Start _get_guest_xml network_info=[{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8cb0b083-fb68-48bf-a788-3ac134b00dd8', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30ae278e-aa85-4896-84a1-a5301f5c5ccd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf353614-3578-4b1c-a636-15a160b4a834', 'serial': 'bf353614-3578-4b1c-a636-15a160b4a834'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:28:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:05 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:05 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:05 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb3ea9-762a-42df-b4c8-08b7d89eee8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:28:05 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[785dae2a-950f-4feb-80eb-9dcd269f9bd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834] added
Aug 08 23:28:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[678cf2ff-ade1-4a09-8b06-ac4f6db3812d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76a320-dd13-4097-ab10-d8ff1ab6e23b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzcsBhyu {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzcsBhyu" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34519c4-0ab1-475f-85e2-62cabe341cbd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NzcsBhyu'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ddc05a-2212-4c3d-97f5-50131cde9fc8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39fc9b9-1058-4e42-944b-27bbbadf893f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06ae37-8314-4bfb-8593-261fd7592e02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]
Aug 08 23:28:05 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.
Aug 08 23:28:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02128d-076e-4a9b-a5e4-fa888e9937ab]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc395e-b930-4647-a7de-cc97cdfedc73]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c406763-8aff-4ff1-9134-17e1545239a3]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23634393238373231', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634393238373231', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1879559594',display_name='tempest-TestShelveInstance-server-1879559594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1879559594',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMQPbmgGwiwmfcSvnP4zk8kB/DIa6fkpGy/NXzZIly5roH+tc7tcLgZFTKtcUNuntPXCRUUJ+w5Mz4sfHrTkcoyXwF37gSP0OmzMumpwGfmFJbaJhlfCRbBueeZSay3eg==',key_name='tempest-TestShelveInstance-350639281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d232f86412044a58663caf23a71cc3b',ramdisk_id='',reservation_id='r-wt4dngfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1642333906',owner_user_name='tempest-TestShelveInstance-1642333906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:27:55Z,user_data=None,user_id='3e3c4d0e349b49f0ac2151b1bcb1af87',uuid=30ae278e-aa85-4896-84a1-a5301f5c5ccd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converting VIF {"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:28:06 user nova-compute[72405]:   <uuid>30ae278e-aa85-4896-84a1-a5301f5c5ccd</uuid>
Aug 08 23:28:06 user nova-compute[72405]:   <name>instance-00000013</name>
Aug 08 23:28:06 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:28:06 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:28:06 user nova-compute[72405]:   <metadata>
Aug 08 23:28:06 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:28:06 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:28:06 user nova-compute[72405]:       <nova:name>tempest-TestShelveInstance-server-1879559594</nova:name>
Aug 08 23:28:06 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:28:05</nova:creationTime>
Aug 08 23:28:06 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:28:06 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:28:06 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:28:06 user nova-compute[72405]:       <nova:owner>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:user uuid="3e3c4d0e349b49f0ac2151b1bcb1af87">tempest-TestShelveInstance-1642333906-project-member</nova:user>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:project uuid="3d232f86412044a58663caf23a71cc3b">tempest-TestShelveInstance-1642333906</nova:project>
Aug 08 23:28:06 user nova-compute[72405]:       </nova:owner>
Aug 08 23:28:06 user nova-compute[72405]:       <nova:ports>
Aug 08 23:28:06 user nova-compute[72405]:         <nova:port uuid="1bc5f924-bce3-4575-b361-f65e36f62b88">
Aug 08 23:28:06 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 08 23:28:06 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:06 user nova-compute[72405]:       </nova:ports>
Aug 08 23:28:06 user nova-compute[72405]:     </nova:instance>
Aug 08 23:28:06 user nova-compute[72405]:   </metadata>
Aug 08 23:28:06 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:28:06 user nova-compute[72405]:     <system>
Aug 08 23:28:06 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:28:06 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:28:06 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:28:06 user nova-compute[72405]:       <entry name="serial">30ae278e-aa85-4896-84a1-a5301f5c5ccd</entry>
Aug 08 23:28:06 user nova-compute[72405]:       <entry name="uuid">30ae278e-aa85-4896-84a1-a5301f5c5ccd</entry>
Aug 08 23:28:06 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:28:06 user nova-compute[72405]:     </system>
Aug 08 23:28:06 user nova-compute[72405]:   </sysinfo>
Aug 08 23:28:06 user nova-compute[72405]:   <os>
Aug 08 23:28:06 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:28:06 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:28:06 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:28:06 user nova-compute[72405]:   </os>
Aug 08 23:28:06 user nova-compute[72405]:   <features>
Aug 08 23:28:06 user nova-compute[72405]:     <acpi/>
Aug 08 23:28:06 user nova-compute[72405]:     <apic/>
Aug 08 23:28:06 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:28:06 user nova-compute[72405]:   </features>
Aug 08 23:28:06 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:28:06 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:28:06 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:28:06 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:28:06 user nova-compute[72405]:   </clock>
Aug 08 23:28:06 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:28:06 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:28:06 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:28:06 user nova-compute[72405]:   </cpu>
Aug 08 23:28:06 user nova-compute[72405]:   <devices>
Aug 08 23:28:06 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:28:06 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:06 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:28:06 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:28:06 user nova-compute[72405]:       <serial>bf353614-3578-4b1c-a636-15a160b4a834</serial>
Aug 08 23:28:06 user nova-compute[72405]:     </disk>
Aug 08 23:28:06 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:06 user nova-compute[72405]:       <mac address="fa:16:3e:7d:1c:56"/>
Aug 08 23:28:06 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:06 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:06 user nova-compute[72405]:       <target dev="tap1bc5f924-bc"/>
Aug 08 23:28:06 user nova-compute[72405]:     </interface>
Aug 08 23:28:06 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:28:06 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd/console.log" append="off"/>
Aug 08 23:28:06 user nova-compute[72405]:     </serial>
Aug 08 23:28:06 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:28:06 user nova-compute[72405]:     <video>
Aug 08 23:28:06 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:06 user nova-compute[72405]:     </video>
Aug 08 23:28:06 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:28:06 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:28:06 user nova-compute[72405]:     </rng>
Aug 08 23:28:06 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:28:06 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:28:06 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:28:06 user nova-compute[72405]:     </memballoon>
Aug 08 23:28:06 user nova-compute[72405]:   </devices>
Aug 08 23:28:06 user nova-compute[72405]: </domain>
Aug 08 23:28:06 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1879559594',display_name='tempest-TestShelveInstance-server-1879559594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1879559594',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMQPbmgGwiwmfcSvnP4zk8kB/DIa6fkpGy/NXzZIly5roH+tc7tcLgZFTKtcUNuntPXCRUUJ+w5Mz4sfHrTkcoyXwF37gSP0OmzMumpwGfmFJbaJhlfCRbBueeZSay3eg==',key_name='tempest-TestShelveInstance-350639281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d232f86412044a58663caf23a71cc3b',ramdisk_id='',reservation_id='r-wt4dngfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1642333906',owner_user_name='tempest-TestShelveInstance-1642333906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:27:55Z,user_data=None,user_id='3e3c4d0e349b49f0ac2151b1bcb1af87',uuid=30ae278e-aa85-4896-84a1-a5301f5c5ccd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converting VIF {"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG os_vif [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bc5f924-bc, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bc5f924-bc, col_values=(('external_ids', {'iface-id': '1bc5f924-bce3-4575-b361-f65e36f62b88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:1c:56', 'vm-uuid': '30ae278e-aa85-4896-84a1-a5301f5c5ccd'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:06 user nova-compute[72405]: INFO os_vif [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc')
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:28:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] No VIF found with MAC fa:16:3e:7d:1c:56, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-d07f0ced-cc02-44ea-aac8-4951cd5100fb req-f9a80265-970f-449b-82e7-64fc64a8ea51 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d07f0ced-cc02-44ea-aac8-4951cd5100fb req-f9a80265-970f-449b-82e7-64fc64a8ea51 service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d07f0ced-cc02-44ea-aac8-4951cd5100fb req-f9a80265-970f-449b-82e7-64fc64a8ea51 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d07f0ced-cc02-44ea-aac8-4951cd5100fb req-f9a80265-970f-449b-82e7-64fc64a8ea51 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-d07f0ced-cc02-44ea-aac8-4951cd5100fb req-f9a80265-970f-449b-82e7-64fc64a8ea51 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:08 user nova-compute[72405]: WARNING nova.compute.manager [req-d07f0ced-cc02-44ea-aac8-4951cd5100fb req-f9a80265-970f-449b-82e7-64fc64a8ea51 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state building and task_state spawning.
Aug 08 23:28:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537290.4477832, 30ae278e-aa85-4896-84a1-a5301f5c5ccd => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] VM Resumed (Lifecycle Event)
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance spawned successfully.
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537290.4490135, 30ae278e-aa85-4896-84a1-a5301f5c5ccd => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] VM Started (Lifecycle Event)
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-d0344356-cbf7-43e8-8531-ee8fa5b07569 req-6c4f2578-1d88-4a3a-bae2-a88af73880af service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d0344356-cbf7-43e8-8531-ee8fa5b07569 req-6c4f2578-1d88-4a3a-bae2-a88af73880af service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d0344356-cbf7-43e8-8531-ee8fa5b07569 req-6c4f2578-1d88-4a3a-bae2-a88af73880af service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d0344356-cbf7-43e8-8531-ee8fa5b07569 req-6c4f2578-1d88-4a3a-bae2-a88af73880af service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-d0344356-cbf7-43e8-8531-ee8fa5b07569 req-6c4f2578-1d88-4a3a-bae2-a88af73880af service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:10 user nova-compute[72405]: WARNING nova.compute.manager [req-d0344356-cbf7-43e8-8531-ee8fa5b07569 req-6c4f2578-1d88-4a3a-bae2-a88af73880af service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state building and task_state spawning.
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Terminating instance
Aug 08 23:28:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:28:10 user nova-compute[72405]: INFO nova.compute.manager [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Took 16.51 seconds to build instance.
Aug 08 23:28:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d23d7379-6c9f-404c-9e10-2ca46ebf95d3 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.653s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-2c26e2a3-6d6d-4ba9-9a65-df5d41a85598 req-8249563c-c5ac-476c-b9fc-9bca8c77cf66 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-vif-unplugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2c26e2a3-6d6d-4ba9-9a65-df5d41a85598 req-8249563c-c5ac-476c-b9fc-9bca8c77cf66 service nova] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2c26e2a3-6d6d-4ba9-9a65-df5d41a85598 req-8249563c-c5ac-476c-b9fc-9bca8c77cf66 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2c26e2a3-6d6d-4ba9-9a65-df5d41a85598 req-8249563c-c5ac-476c-b9fc-9bca8c77cf66 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-2c26e2a3-6d6d-4ba9-9a65-df5d41a85598 req-8249563c-c5ac-476c-b9fc-9bca8c77cf66 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] No waiting events found dispatching network-vif-unplugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-2c26e2a3-6d6d-4ba9-9a65-df5d41a85598 req-8249563c-c5ac-476c-b9fc-9bca8c77cf66 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-vif-unplugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:28:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Instance destroyed successfully.
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'resources' on Instance uuid 51cd87b7-e26e-4bb0-9b07-8f22e3244935 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833179845',display_name='tempest-VolumesAdminNegativeTest-server-1833179845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833179845',id=15,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:26:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c2ac2c8f4474e83abe622858fe2fd1d',ramdisk_id='',reservation_id='r-r6rn5lwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1763761892',owner_user_name='tempest-VolumesAdminNegativeTest-1763761892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:26:13Z,user_data=None,user_id='5d9d95793fbe40989729a80e72bde91d',uuid=51cd87b7-e26e-4bb0-9b07-8f22e3244935,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converting VIF {"id": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "address": "fa:16:3e:2f:97:3e", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa1d28a-84", "ovs_interfaceid": "ffa1d28a-84fc-4b9a-af69-b2a3e38b781a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG os_vif [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffa1d28a-84, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:11 user nova-compute[72405]: INFO os_vif [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:97:3e,bridge_name='br-int',has_traffic_filtering=True,id=ffa1d28a-84fc-4b9a-af69-b2a3e38b781a,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa1d28a-84')
Aug 08 23:28:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Deleting instance files /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935_del
Aug 08 23:28:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Deletion of /opt/stack/data/nova/instances/51cd87b7-e26e-4bb0-9b07-8f22e3244935_del complete
Aug 08 23:28:11 user nova-compute[72405]: INFO nova.compute.manager [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 08 23:28:11 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:28:11 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:28:12 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:12 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Took 0.75 seconds to deallocate network for instance.
Aug 08 23:28:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd77d0ac-abf1-479d-8090-c249e41e42a5 req-d0388ab9-9119-4696-8056-95aa2d2c96b9 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-vif-deleted-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:13 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Deleted allocations for instance 51cd87b7-e26e-4bb0-9b07-8f22e3244935
Aug 08 23:28:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f4709117-c052-4223-ab92-51f552bd772c tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e1651e0-645f-470f-b913-31153d69d48b req-2fcf3118-057c-427a-943d-9cbd1b68c412 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received event network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e1651e0-645f-470f-b913-31153d69d48b req-2fcf3118-057c-427a-943d-9cbd1b68c412 service nova] Acquiring lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e1651e0-645f-470f-b913-31153d69d48b req-2fcf3118-057c-427a-943d-9cbd1b68c412 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e1651e0-645f-470f-b913-31153d69d48b req-2fcf3118-057c-427a-943d-9cbd1b68c412 service nova] Lock "51cd87b7-e26e-4bb0-9b07-8f22e3244935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e1651e0-645f-470f-b913-31153d69d48b req-2fcf3118-057c-427a-943d-9cbd1b68c412 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] No waiting events found dispatching network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:13 user nova-compute[72405]: WARNING nova.compute.manager [req-1e1651e0-645f-470f-b913-31153d69d48b req-2fcf3118-057c-427a-943d-9cbd1b68c412 service nova] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Received unexpected event network-vif-plugged-ffa1d28a-84fc-4b9a-af69-b2a3e38b781a for instance with vm_state deleted and task_state None.
Aug 08 23:28:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:15 user nova-compute[72405]: INFO nova.compute.manager [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Terminating instance
Aug 08 23:28:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:28:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-74118fe4-ff4c-45be-9460-886977623b82 req-a0d010a5-f9ec-4010-a1fd-b2c8e868f092 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-vif-unplugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74118fe4-ff4c-45be-9460-886977623b82 req-a0d010a5-f9ec-4010-a1fd-b2c8e868f092 service nova] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74118fe4-ff4c-45be-9460-886977623b82 req-a0d010a5-f9ec-4010-a1fd-b2c8e868f092 service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74118fe4-ff4c-45be-9460-886977623b82 req-a0d010a5-f9ec-4010-a1fd-b2c8e868f092 service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-74118fe4-ff4c-45be-9460-886977623b82 req-a0d010a5-f9ec-4010-a1fd-b2c8e868f092 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] No waiting events found dispatching network-vif-unplugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-74118fe4-ff4c-45be-9460-886977623b82 req-a0d010a5-f9ec-4010-a1fd-b2c8e868f092 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-vif-unplugged-70d723e8-ffab-45b2-8455-a96d579d5e06 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:28:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Instance destroyed successfully.
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lazy-loading 'resources' on Instance uuid c3e19ae0-d188-4ed4-80f1-569c5785f5e4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-418018861',display_name='tempest-VolumesNegativeTest-instance-418018861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-418018861',id=16,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:26:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac407be4c6ba4c17aae707e8546caab1',ramdisk_id='',reservation_id='r-zb8kysqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-411144724',owner_user_name='tempest-VolumesNegativeTest-411144724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:26:36Z,user_data=None,user_id='66b18b3f5935470f8d6b531f058c7d8c',uuid=c3e19ae0-d188-4ed4-80f1-569c5785f5e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Converting VIF {"id": "70d723e8-ffab-45b2-8455-a96d579d5e06", "address": "fa:16:3e:b8:44:79", "network": {"id": "c3a951e6-0275-4e3e-a5ec-d5b042f8581f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "709d55a5d7b94f2b8e6bf80fcfeaf933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d723e8-ff", "ovs_interfaceid": "70d723e8-ffab-45b2-8455-a96d579d5e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG os_vif [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d723e8-ff, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:16 user nova-compute[72405]: INFO os_vif [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:44:79,bridge_name='br-int',has_traffic_filtering=True,id=70d723e8-ffab-45b2-8455-a96d579d5e06,network=Network(c3a951e6-0275-4e3e-a5ec-d5b042f8581f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d723e8-ff')
Aug 08 23:28:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Deleting instance files /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4_del
Aug 08 23:28:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Deletion of /opt/stack/data/nova/instances/c3e19ae0-d188-4ed4-80f1-569c5785f5e4_del complete
Aug 08 23:28:16 user nova-compute[72405]: INFO nova.compute.manager [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 08 23:28:16 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:28:16 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:28:17 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:17 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Took 0.71 seconds to deallocate network for instance.
Aug 08 23:28:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:17 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:28:17 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:28:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:17 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Deleted allocations for instance c3e19ae0-d188-4ed4-80f1-569c5785f5e4
Aug 08 23:28:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d1a7743-4f76-491a-ab73-edda71189830 tempest-VolumesNegativeTest-411144724 tempest-VolumesNegativeTest-411144724-project-member] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] Acquiring lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] Lock "c3e19ae0-d188-4ed4-80f1-569c5785f5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] No waiting events found dispatching network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:18 user nova-compute[72405]: WARNING nova.compute.manager [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received unexpected event network-vif-plugged-70d723e8-ffab-45b2-8455-a96d579d5e06 for instance with vm_state deleted and task_state None.
Aug 08 23:28:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-72be6cae-44c2-49f3-9a84-db9da413227a req-6d5e01e6-d0a3-4daf-92b7-d16132ab8da6 service nova] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Received event network-vif-deleted-70d723e8-ffab-45b2-8455-a96d579d5e06 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:28:25 user nova-compute[72405]: INFO nova.compute.claims [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Claim successful on node user
Aug 08 23:28:25 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:28:26 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:28:26 user nova-compute[72405]: INFO nova.virt.block_device [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Booting with volume dec97cf5-134c-4d8c-aefd-400b4e5a2239 at /dev/vda
Aug 08 23:28:26 user nova-compute[72405]: DEBUG os_brick.utils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6bdac4-1b7c-490d-a744-f59719159c76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.policy [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '437d3dd1e1484bf5b5bf0c05cacc1782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e83aa1a58c4be78275fb938dd39ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad64aad-2112-4a49-af8a-e7666e796a0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4b7dcf-1050-4adf-ade8-6f9b61608446]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[771037e4-1077-4502-9e07-fc1466e748e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:28:26 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:28:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[409defb3-d97a-4477-b1f7-408b0f8ef277]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG os_brick.utils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating existing volume attachment record: 6877f250-ac7d-404f-bc18-7b6c917d9fbf {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537291.60268, 51cd87b7-e26e-4bb0-9b07-8f22e3244935 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:26 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] VM Stopped (Lifecycle Event)
Aug 08 23:28:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8106d1e8-57ff-4cac-9da1-c286e169ce0e None None] [instance: 51cd87b7-e26e-4bb0-9b07-8f22e3244935] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully created port: 9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:28:27 user nova-compute[72405]: INFO nova.compute.claims [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Claim successful on node user
Aug 08 23:28:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully created port: d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.network.neutron [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:28:28 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.policy [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2e4ec54172a455187e10b1b119c8cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628adffbe7ca403b8dc9c26f8254cddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:28:28 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Creating image(s)
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully created port: 8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.166s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk 1073741824" returned: 0 in 0.058s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Successfully created port: eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Cannot resize image /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'migration_context' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Ensure instance console log exists: /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully created port: bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Successfully updated port: eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-changed-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Refreshing instance network info cache due to event network-changed-eac5523e-985c-4a32-b6a6-b75f08a00cf9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully created port: d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updating instance_info_cache with network_info: [{"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-8fba4b8e-8a40-473a-9fc2-2d06ec128463" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance network_info: |[{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Refreshing network info cache for port eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Start _get_guest_xml network_info=[{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:28:30 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:30 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525172976',display_name='tempest-ServerActionsTestOtherA-server-1525172976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525172976',id=21,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-eqwjzdat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=e5fc6348-e237-4f86-8179-c5dc34b9e1d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'pci_devices' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:28:30 user nova-compute[72405]:   <uuid>e5fc6348-e237-4f86-8179-c5dc34b9e1d2</uuid>
Aug 08 23:28:30 user nova-compute[72405]:   <name>instance-00000015</name>
Aug 08 23:28:30 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:28:30 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:28:30 user nova-compute[72405]:   <metadata>
Aug 08 23:28:30 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:28:30 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:28:30 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherA-server-1525172976</nova:name>
Aug 08 23:28:30 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:28:30</nova:creationTime>
Aug 08 23:28:30 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:28:30 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:28:30 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:28:30 user nova-compute[72405]:       <nova:owner>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:user uuid="f2e4ec54172a455187e10b1b119c8cec">tempest-ServerActionsTestOtherA-1743133349-project-member</nova:user>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:project uuid="628adffbe7ca403b8dc9c26f8254cddb">tempest-ServerActionsTestOtherA-1743133349</nova:project>
Aug 08 23:28:30 user nova-compute[72405]:       </nova:owner>
Aug 08 23:28:30 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:28:30 user nova-compute[72405]:       <nova:ports>
Aug 08 23:28:30 user nova-compute[72405]:         <nova:port uuid="eac5523e-985c-4a32-b6a6-b75f08a00cf9">
Aug 08 23:28:30 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:28:30 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:30 user nova-compute[72405]:       </nova:ports>
Aug 08 23:28:30 user nova-compute[72405]:     </nova:instance>
Aug 08 23:28:30 user nova-compute[72405]:   </metadata>
Aug 08 23:28:30 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:28:30 user nova-compute[72405]:     <system>
Aug 08 23:28:30 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:28:30 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:28:30 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:28:30 user nova-compute[72405]:       <entry name="serial">e5fc6348-e237-4f86-8179-c5dc34b9e1d2</entry>
Aug 08 23:28:30 user nova-compute[72405]:       <entry name="uuid">e5fc6348-e237-4f86-8179-c5dc34b9e1d2</entry>
Aug 08 23:28:30 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:28:30 user nova-compute[72405]:     </system>
Aug 08 23:28:30 user nova-compute[72405]:   </sysinfo>
Aug 08 23:28:30 user nova-compute[72405]:   <os>
Aug 08 23:28:30 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:28:30 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:28:30 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:28:30 user nova-compute[72405]:   </os>
Aug 08 23:28:30 user nova-compute[72405]:   <features>
Aug 08 23:28:30 user nova-compute[72405]:     <acpi/>
Aug 08 23:28:30 user nova-compute[72405]:     <apic/>
Aug 08 23:28:30 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:28:30 user nova-compute[72405]:   </features>
Aug 08 23:28:30 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:28:30 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:28:30 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:28:30 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:28:30 user nova-compute[72405]:   </clock>
Aug 08 23:28:30 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:28:30 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:28:30 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:28:30 user nova-compute[72405]:   </cpu>
Aug 08 23:28:30 user nova-compute[72405]:   <devices>
Aug 08 23:28:30 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:28:30 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:28:30 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk"/>
Aug 08 23:28:30 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:28:30 user nova-compute[72405]:     </disk>
Aug 08 23:28:30 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:30 user nova-compute[72405]:       <mac address="fa:16:3e:0c:91:38"/>
Aug 08 23:28:30 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:30 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:30 user nova-compute[72405]:       <target dev="tapeac5523e-98"/>
Aug 08 23:28:30 user nova-compute[72405]:     </interface>
Aug 08 23:28:30 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:28:30 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/console.log" append="off"/>
Aug 08 23:28:30 user nova-compute[72405]:     </serial>
Aug 08 23:28:30 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:28:30 user nova-compute[72405]:     <video>
Aug 08 23:28:30 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:30 user nova-compute[72405]:     </video>
Aug 08 23:28:30 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:28:30 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:28:30 user nova-compute[72405]:     </rng>
Aug 08 23:28:30 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:28:30 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:28:30 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:28:30 user nova-compute[72405]:     </memballoon>
Aug 08 23:28:30 user nova-compute[72405]:   </devices>
Aug 08 23:28:30 user nova-compute[72405]: </domain>
Aug 08 23:28:30 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525172976',display_name='tempest-ServerActionsTestOtherA-server-1525172976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525172976',id=21,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-eqwjzdat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=e5fc6348-e237-4f86-8179-c5dc34b9e1d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG os_vif [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac5523e-98, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeac5523e-98, col_values=(('external_ids', {'iface-id': 'eac5523e-985c-4a32-b6a6-b75f08a00cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:91:38', 'vm-uuid': 'e5fc6348-e237-4f86-8179-c5dc34b9e1d2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:30 user nova-compute[72405]: INFO os_vif [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98')
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:28:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No VIF found with MAC fa:16:3e:0c:91:38, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: 9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-9d662e25-ca05-4576-afb5-96314a853b4c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port 9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537296.547405, c3e19ae0-d188-4ed4-80f1-569c5785f5e4 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:31 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] VM Stopped (Lifecycle Event)
Aug 08 23:28:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e6713785-c460-4267-a0d9-28cb13a174f0 None None] [instance: c3e19ae0-d188-4ed4-80f1-569c5785f5e4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updated VIF entry in instance network info cache for port eac5523e-985c-4a32-b6a6-b75f08a00cf9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8914cfd8-556e-44ff-843f-4adb90b49664 req-9392b591-b882-42d8-9c69-9c4c3fc1eed5 service nova] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a2a688ac-be05-41f6-add0-62e7073517e0 req-d6e177f6-44fa-4ec0-a483-8678bc1076b7 service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:32 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:33 user nova-compute[72405]: INFO nova.compute.manager [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Detaching volume fb83d67a-835b-403c-8a53-b4289f44490e
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:33 user nova-compute[72405]: INFO nova.virt.block_device [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Attempting to driver detach volume fb83d67a-835b-403c-8a53-b4289f44490e from mountpoint /dev/vdb
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Attempting to detach device vdb from instance 80e7599c-bd2a-499d-9b2b-4c613f375900 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:28:33 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:33 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:28:33 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:28:33 user nova-compute[72405]:   <serial>fb83d67a-835b-403c-8a53-b4289f44490e</serial>
Aug 08 23:28:33 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:28:33 user nova-compute[72405]: </disk>
Aug 08 23:28:33 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:28:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully detached device vdb from instance 80e7599c-bd2a-499d-9b2b-4c613f375900 from the persistent domain config.
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80e7599c-bd2a-499d-9b2b-4c613f375900 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:28:33 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:33 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:28:33 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:28:33 user nova-compute[72405]:   <serial>fb83d67a-835b-403c-8a53-b4289f44490e</serial>
Aug 08 23:28:33 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:28:33 user nova-compute[72405]: </disk>
Aug 08 23:28:33 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:33 user nova-compute[72405]: WARNING nova.compute.manager [req-c42a67a8-18f4-43b8-a945-7eaf6619d08e req-1db14ad7-e978-4d05-aeaf-2c22f3919caa service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state building and task_state spawning.
Aug 08 23:28:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: 15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: INFO nova.compute.manager [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Detaching volume 70079ec1-e2b4-43e8-9278-2c732633c108
Aug 08 23:28:34 user nova-compute[72405]: INFO nova.virt.block_device [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Attempting to driver detach volume 70079ec1-e2b4-43e8-9278-2c732633c108 from mountpoint /dev/vdc
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537314.1690948, 80e7599c-bd2a-499d-9b2b-4c613f375900 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:28:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully detached device vdb from instance 80e7599c-bd2a-499d-9b2b-4c613f375900 from the live domain config.
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqvxiMfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:34 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Attempting to detach device vdc from instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:28:34 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:34 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:28:34 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:28:34 user nova-compute[72405]:   <serial>70079ec1-e2b4-43e8-9278-2c732633c108</serial>
Aug 08 23:28:34 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:28:34 user nova-compute[72405]: </disk>
Aug 08 23:28:34 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9261379-ba06-4e00-892d-f6e3e26bd6de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully detached device vdc from instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c from the persistent domain config.
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:28:34 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:34 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:28:34 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:28:34 user nova-compute[72405]:   <serial>70079ec1-e2b4-43e8-9278-2c732633c108</serial>
Aug 08 23:28:34 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:28:34 user nova-compute[72405]: </disk>
Aug 08 23:28:34 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[90546301-5700-46ed-99d7-d3643bf792b2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f3f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326887e-2eae-4740-9932-1413a3b2e8e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c9b9c-7352-4082-9e46-6b86bac92953]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[97baaafe-76ec-4e26-a18e-00b78bc12f76]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bef392d-d4bf-4f74-80c5-bc132af372f1]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[02786122-7da8-47e8-9017-36105c6f1021]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4346b45-1842-4a5b-af37-b1a71d39d2a9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260]
Aug 08 23:28:34 user nova-compute[72405]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e, portal: 172.16.0.220,3260] successful.
Aug 08 23:28:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb83d67a-835b-403c-8a53-b4289f44490e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd37fed-b89e-4af3-8d1f-e9da316ae129]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== disconnect_volume: return (412ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537314.7356184, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:28:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully detached device vdc from instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c from the live domain config.
Aug 08 23:28:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPfJQMZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:34 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a21338-131e-4b5a-8366-a1adc62457d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f6ff5f-ebaf-4096-8553-7fa3af52a446]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f3f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea245f-936d-4aa2-bd93-4b6b774f1b6b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31e6059-f07e-4b6a-a7da-16e9a374db40]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f50c53-5f44-42da-b98c-fac156599090]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:28:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0807633a-5142-4ef2-990f-d6eddd75fed8]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a7bc0-07af-4089-a2c1-7cf6fa9b1667]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a5867d-798c-4dc2-9b85-e361d09680d3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537315.1700149, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] VM Resumed (Lifecycle Event)
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260]
Aug 08 23:28:35 user nova-compute[72405]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108, portal: 172.16.0.220,3260] successful.
Aug 08 23:28:35 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance spawned successfully.
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70079ec1-e2b4-43e8-9278-2c732633c108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4bfdb-e48e-48c4-853d-e71314010428]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] <== disconnect_volume: return (458ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537315.1717546, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] VM Started (Lifecycle Event)
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:35 user nova-compute[72405]: WARNING nova.compute.manager [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state building and task_state spawning.
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-15730843-12df-450c-a0ba-6b35564e526f. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port 15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Took 6.88 seconds to spawn the instance on the hypervisor.
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:35 user nova-compute[72405]: INFO nova.compute.manager [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Took 7.88 seconds to build instance.
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-603784b6-ddf3-45e9-9e0c-319742fb9769 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.987s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-23f68e8e-bf26-4df7-a80c-48df282fe3f8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.224s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-56503210-799f-4ddd-ae12-6c1e04432dc1 req-a0791be2-25c6-4cd6-9405-8cc203530b7f service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72405) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 08 23:28:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:36 user nova-compute[72405]: INFO nova.virt.block_device [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Booting with volume f1d99145-7be3-488e-9149-8c4521c0748b at /dev/vdb
Aug 08 23:28:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG os_brick.utils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a21613-bcb7-4259-841d-3f18b4788777]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab95df26-8b90-4fd7-9489-d1b1e0a783cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG nova.objects.instance [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'flavor' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb988bb-9a47-4a7e-959d-b4a98c38eaea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270df79-3717-4acc-bc88-98a161e61b0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:28:36 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3d804-3ec6-4e87-b634-e07ca6ce9ffd]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG os_brick.utils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== get_connector_properties: return (238ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating existing volume attachment record: 334056ee-4335-42d2-a1ad-a3d51962a349 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84d61b96-c247-4b16-af98-f785c213c785 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.563s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance destroyed successfully.
Aug 08 23:28:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: 8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-d87ef898-e971-4f53-9983-08d9f93a9e84. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.network.neutron [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b2ad02b5-c952-409d-80ad-ba411cf455ec tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.722s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:37 user nova-compute[72405]: INFO nova.compute.manager [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Terminating instance
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:28:37 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:37 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7167MB free_disk=25.489234924316406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG nova.network.neutron [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.network.neutron [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:38 user nova-compute[72405]: WARNING nova.compute.manager [req-2e613f5b-cc09-4163-af2f-0ea001e63cbc req-9a3d76f5-c6ff-414e-a5f0-9b53917cbeea service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state stopped and task_state None.
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 30ae278e-aa85-4896-84a1-a5301f5c5ccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance c072a4fb-12b6-41dd-ae55-fefa191c46c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Instance destroyed successfully.
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'resources' on Instance uuid 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-395984649',display_name='tempest-AttachVolumeNegativeTest-server-395984649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-395984649',id=4,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVskqEeg50RKMxJkJVi4ko7k4s8eUARaDtCTgw/m3lw4nhP4jV/u1xIqv7cOLIXjn+ff7Xjh3wNZHdsROkFDVqr+iKtgiIrQL7MOpErjmWUL1wYO9reDFjXhROY9OlZ6g==',key_name='tempest-keypair-1263103113',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-tq30zn0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:22:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=2b6e716f-3376-4f79-8ad5-95bd1d5231f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "95cda028-ebac-494b-a9cc-0e4b0511d395", "address": "fa:16:3e:3e:2c:15", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cda028-eb", "ovs_interfaceid": "95cda028-ebac-494b-a9cc-0e4b0511d395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG os_vif [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95cda028-eb, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:38 user nova-compute[72405]: INFO os_vif [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=95cda028-ebac-494b-a9cc-0e4b0511d395,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cda028-eb')
Aug 08 23:28:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Deleting instance files /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7_del
Aug 08 23:28:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Deletion of /opt/stack/data/nova/instances/2b6e716f-3376-4f79-8ad5-95bd1d5231f7_del complete
Aug 08 23:28:38 user nova-compute[72405]: INFO nova.compute.manager [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 08 23:28:38 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:28:38 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.307s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-8940fbb3-e675-4b99-abe3-e78516ccdd08. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port 8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Successfully updated port: d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:40 user nova-compute[72405]: WARNING nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state stopped and task_state None.
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-vif-unplugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] No waiting events found dispatching network-vif-unplugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-vif-unplugged-95cda028-ebac-494b-a9cc-0e4b0511d395 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquiring lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] No waiting events found dispatching network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:28:40 user nova-compute[72405]: WARNING nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received unexpected event network-vif-plugged-95cda028-ebac-494b-a9cc-0e4b0511d395 for instance with vm_state active and task_state deleting.
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:40 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Took 1.50 seconds to deallocate network for instance.
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dec3897-6300-4199-bf38-217594ff91a4 req-beacc21f-c8b3-4a85-b69d-3c3321b3dabe service nova] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Received event network-vif-deleted-95cda028-ebac-494b-a9cc-0e4b0511d395 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f48e2e19-528f-4012-aee7-3973898c938a req-292e1e02-2b2b-4bb3-b784-0737fa233385 service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:28:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:41 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Deleted allocations for instance 2b6e716f-3376-4f79-8ad5-95bd1d5231f7
Aug 08 23:28:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:28:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-46208b32-a8bc-4551-83e5-cb5a6615cdad tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "2b6e716f-3376-4f79-8ad5-95bd1d5231f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.391s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:28:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-d8f79854-a86d-4032-bc96-002ec5ef3dfe. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:28:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance network_info: |[{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updated VIF entry in instance network info cache for port d8f79854-a86d-4032-bc96-002ec5ef3dfe. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ca2f4dce-9643-43b6-8815-bb2b1b3e7aaa req-28818e9b-a9e5-41f2-b40e-aab3a8b35ab6 service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:28:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:46 user nova-compute[72405]: INFO nova.virt.block_device [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Booting with volume 36b205aa-4e5d-473f-9c3b-ff419fea7ac2 at /dev/vdc
Aug 08 23:28:46 user nova-compute[72405]: DEBUG os_brick.utils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad13456-d0a1-4bc8-92be-b473355d638f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d4ce4-51ce-4884-bb9d-a579881e7dbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa99e6d-743f-4364-a3db-364cd0090900]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc0127-3819-44e2-917d-42f9f82755a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:28:46 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:28:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bfaf99-9c52-4fc3-a089-6d3cf3fa65f3]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG os_brick.utils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:46 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating existing volume attachment record: 974c0df5-4d35-4389-9b5c-cb91a3559fdf {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:28:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:51 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537316.8972042, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:51 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Stopped (Lifecycle Event)
Aug 08 23:28:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f68f3dc6-3c64-4842-a707-f2e5ec8dd171 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f68f3dc6-3c64-4842-a707-f2e5ec8dd171 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:28:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:53 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537318.789235, 2b6e716f-3376-4f79-8ad5-95bd1d5231f7 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:28:53 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] VM Stopped (Lifecycle Event)
Aug 08 23:28:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-10e5d0a6-201b-4bf8-9fb3-7899076ef6d1 None None] [instance: 2b6e716f-3376-4f79-8ad5-95bd1d5231f7] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:28:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:28:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Creating image(s)
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Ensure instance console log exists: /opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Start _get_guest_xml network_info=[{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6877f250-ac7d-404f-bc18-7b6c917d9fbf', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mixhzoMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'dec97cf5-134c-4d8c-aefd-400b4e5a2239', 'serial': 'dec97cf5-134c-4d8c-aefd-400b4e5a2239'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '334056ee-4335-42d2-a1ad-a3d51962a349', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QznjAFHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1d99145-7be3-488e-9149-8c4521c0748b', 'serial': 'f1d99145-7be3-488e-9149-8c4521c0748b'}, 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '974c0df5-4d35-4389-9b5c-cb91a3559fdf', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAYxZGak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1', 'attached_at': '', 'detached_at': '', 'volume_id': '36b205aa-4e5d-473f-9c3b-ff419fea7ac2', 'serial': '36b205aa-4e5d-473f-9c3b-ff419fea7ac2'}, 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:28:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mixhzoMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:55 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:55 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:55 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[836f2516-7992-40d5-bc0d-a10bf2e22868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:28:55 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[da31674d-444a-4996-a5e0-77de1d26363a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239] added
Aug 08 23:28:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8569f57b-6fcd-4a4e-bc83-114cf2c5073b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7895b736-138a-48f4-88f8-b68d5ef265c2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mixhzoMy {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mixhzoMy" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb7400-9614-4adc-97a9-fdf77948c6ce]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mixhzoMy'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[421303c4-b28c-475b-8d0a-b747b38a96a6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3216497-0f66-41ed-a09a-e5df5f3c9022]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[695d4698-0e12-46cf-8304-d83918556d9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260]
Aug 08 23:28:55 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260] successful.
Aug 08 23:28:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[73093324-0c77-41b5-aff1-ed46e1830d82]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a2469-db7e-43d4-a6db-f93551812387]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[06220424-8569-47f7-bb64-6d9842553381]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:28:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mixhzoMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23138343063333037', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138343063333037', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QznjAFHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:56 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:56 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:56 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e7fe36-8859-472b-b97a-8bcffdaf53ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:28:56 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb24e64b-1c4f-45a3-be11-e83e8b41f294]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b] added
Aug 08 23:28:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8374554-5c28-44fa-875b-043b4e7375e0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf56318-6ad1-4759-a695-560491db3389]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QznjAFHS {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QznjAFHS" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a7509c-7f6e-4ec5-9480-dbfccc45381d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QznjAFHS'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b02306-d9ec-4d04-88dc-218ff1e7b4f2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48d389-c00c-4325-8d08-6b6cb7298ecd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[09888762-0b15-41fa-90c9-dba1b10b3696]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260]
Aug 08 23:28:56 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260] successful.
Aug 08 23:28:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f00674c-4021-44ab-bb46-267bdcd719b9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c4ab2-204f-49ea-be7b-d98c8e5bc55b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:28:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:56 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:28:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d4cc6-c3b2-4b54-bbca-d9710adca60e]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:28:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QznjAFHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23962333166313932', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962333166313932', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAYxZGak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:28:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:28:57 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3019a1-c683-4b62-94bb-cd25d45317ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:28:57 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606c114-77a9-4734-892f-dd85de910e28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2] added
Aug 08 23:28:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619fe13-ddb5-4732-85b8-105ff3719bd4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd9a04-f67a-499a-a42e-7e4c0256a4de]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAYxZGak {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAYxZGak" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a099f8b6-3a66-4f0e-ab05-93793df6cc11]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAYxZGak'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55c3352-887c-436f-ad1a-51f8511f84ee]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a6001e-68b6-49bb-92aa-0054befe3a8d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:28:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:28:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2306a394-2a72-42fc-920d-61fbc2bd0bef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260]
Aug 08 23:28:58 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260] successful.
Aug 08 23:28:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[78689361-9568-4dc1-932a-fe6e011d1b11]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df0af5-856b-4beb-8370-bbad491171d4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:28:58 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:28:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65f26e-eb8a-4ab9-98dc-c8a5c70a38f4]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAYxZGak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26264386535393564', 'path': '/dev/sdf'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264386535393564', 'path': '/dev/sdf'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.objects.instance [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lazy-loading 'pci_devices' on Instance uuid c072a4fb-12b6-41dd-ae55-fefa191c46c1 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:28:59 user nova-compute[72405]:   <uuid>c072a4fb-12b6-41dd-ae55-fefa191c46c1</uuid>
Aug 08 23:28:59 user nova-compute[72405]:   <name>instance-00000014</name>
Aug 08 23:28:59 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:28:59 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:28:59 user nova-compute[72405]:   <metadata>
Aug 08 23:28:59 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:28:59 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:28:59 user nova-compute[72405]:       <nova:name>tempest-device-tagging-server-2144567651</nova:name>
Aug 08 23:28:59 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:28:55</nova:creationTime>
Aug 08 23:28:59 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:28:59 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:28:59 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:28:59 user nova-compute[72405]:       <nova:owner>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:user uuid="437d3dd1e1484bf5b5bf0c05cacc1782">tempest-TaggedBootDevicesTest_v242-1744341241-project-member</nova:user>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:project uuid="a3e83aa1a58c4be78275fb938dd39ac8">tempest-TaggedBootDevicesTest_v242-1744341241</nova:project>
Aug 08 23:28:59 user nova-compute[72405]:       </nova:owner>
Aug 08 23:28:59 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:28:59 user nova-compute[72405]:       <nova:ports>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="9d662e25-ca05-4576-afb5-96314a853b4c">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="b7c07f90-37b9-44a7-a5be-2dfcfb8c431b">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="15730843-12df-450c-a0ba-6b35564e526f">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="d87ef898-e971-4f53-9983-08d9f93a9e84">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="8940fbb3-e675-4b99-abe3-e78516ccdd08">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:         <nova:port uuid="d8f79854-a86d-4032-bc96-002ec5ef3dfe">
Aug 08 23:28:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 08 23:28:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:28:59 user nova-compute[72405]:       </nova:ports>
Aug 08 23:28:59 user nova-compute[72405]:     </nova:instance>
Aug 08 23:28:59 user nova-compute[72405]:   </metadata>
Aug 08 23:28:59 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:28:59 user nova-compute[72405]:     <system>
Aug 08 23:28:59 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:28:59 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:28:59 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:28:59 user nova-compute[72405]:       <entry name="serial">c072a4fb-12b6-41dd-ae55-fefa191c46c1</entry>
Aug 08 23:28:59 user nova-compute[72405]:       <entry name="uuid">c072a4fb-12b6-41dd-ae55-fefa191c46c1</entry>
Aug 08 23:28:59 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:28:59 user nova-compute[72405]:     </system>
Aug 08 23:28:59 user nova-compute[72405]:   </sysinfo>
Aug 08 23:28:59 user nova-compute[72405]:   <os>
Aug 08 23:28:59 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:28:59 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:28:59 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:28:59 user nova-compute[72405]:   </os>
Aug 08 23:28:59 user nova-compute[72405]:   <features>
Aug 08 23:28:59 user nova-compute[72405]:     <acpi/>
Aug 08 23:28:59 user nova-compute[72405]:     <apic/>
Aug 08 23:28:59 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:28:59 user nova-compute[72405]:   </features>
Aug 08 23:28:59 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:28:59 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:28:59 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:28:59 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:28:59 user nova-compute[72405]:   </clock>
Aug 08 23:28:59 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:28:59 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:28:59 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:28:59 user nova-compute[72405]:   </cpu>
Aug 08 23:28:59 user nova-compute[72405]:   <devices>
Aug 08 23:28:59 user nova-compute[72405]:     <disk type="file" device="cdrom">
Aug 08 23:28:59 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none"/>
Aug 08 23:28:59 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1/disk.config"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="hda" bus="ide"/>
Aug 08 23:28:59 user nova-compute[72405]:     </disk>
Aug 08 23:28:59 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:28:59 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:59 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <serial>dec97cf5-134c-4d8c-aefd-400b4e5a2239</serial>
Aug 08 23:28:59 user nova-compute[72405]:     </disk>
Aug 08 23:28:59 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:28:59 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:59 user nova-compute[72405]:       <source dev="/dev/sde"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <serial>f1d99145-7be3-488e-9149-8c4521c0748b</serial>
Aug 08 23:28:59 user nova-compute[72405]:     </disk>
Aug 08 23:28:59 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:28:59 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:28:59 user nova-compute[72405]:       <source dev="/dev/sdf"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="vdc" bus="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <serial>36b205aa-4e5d-473f-9c3b-ff419fea7ac2</serial>
Aug 08 23:28:59 user nova-compute[72405]:     </disk>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:bb:90:ae"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tap9d662e25-ca"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:0f:ee:ef"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tapb7c07f90-37"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:25:e0:28"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tap15730843-12"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:b8:fb:e9"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tapd87ef898-e9"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:66:04:ce"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tap8940fbb3-e6"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:5f:6f:77"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tapbacf45ab-5e"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:28:59 user nova-compute[72405]:       <mac address="fa:16:3e:a3:4c:5b"/>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:28:59 user nova-compute[72405]:       <target dev="tapd8f79854-a8"/>
Aug 08 23:28:59 user nova-compute[72405]:     </interface>
Aug 08 23:28:59 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:28:59 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1/console.log" append="off"/>
Aug 08 23:28:59 user nova-compute[72405]:     </serial>
Aug 08 23:28:59 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:28:59 user nova-compute[72405]:     <video>
Aug 08 23:28:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:28:59 user nova-compute[72405]:     </video>
Aug 08 23:28:59 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:28:59 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:28:59 user nova-compute[72405]:     </rng>
Aug 08 23:28:59 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:28:59 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:28:59 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:28:59 user nova-compute[72405]:     </memballoon>
Aug 08 23:28:59 user nova-compute[72405]:   </devices>
Aug 08 23:28:59 user nova-compute[72405]: </domain>
Aug 08 23:28:59 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d662e25-ca, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d662e25-ca, col_values=(('external_ids', {'iface-id': '9d662e25-ca05-4576-afb5-96314a853b4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:90:ae', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c07f90-37, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7c07f90-37, col_values=(('external_ids', {'iface-id': 'b7c07f90-37b9-44a7-a5be-2dfcfb8c431b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:ee:ef', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15730843-12, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15730843-12, col_values=(('external_ids', {'iface-id': '15730843-12df-450c-a0ba-6b35564e526f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:e0:28', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd87ef898-e9, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd87ef898-e9, col_values=(('external_ids', {'iface-id': 'd87ef898-e971-4f53-9983-08d9f93a9e84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:fb:e9', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8940fbb3-e6, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8940fbb3-e6, col_values=(('external_ids', {'iface-id': '8940fbb3-e675-4b99-abe3-e78516ccdd08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:04:ce', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbacf45ab-5e, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbacf45ab-5e, col_values=(('external_ids', {'iface-id': 'bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:6f:77', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8f79854-a8, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8f79854-a8, col_values=(('external_ids', {'iface-id': 'd8f79854-a86d-4032-bc96-002ec5ef3dfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:4c:5b', 'vm-uuid': 'c072a4fb-12b6-41dd-ae55-fefa191c46c1'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:28:59 user nova-compute[72405]: INFO os_vif [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8')
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] No BDM found with device name hda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] No VIF found with MAC fa:16:3e:bb:90:ae, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:28:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] No VIF found with MAC fa:16:3e:66:04:ce, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:28:59 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Using config drive
Aug 08 23:28:59 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Creating config drive at /opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1/disk.config
Aug 08 23:28:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0qjvs91b {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0qjvs91b" returned: 0 in 0.082s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-b930e529-26b0-4928-917d-3b6263a2043d req-dcf148a0-52af-4dd0-a34b-7fd41fb0d8e9 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b930e529-26b0-4928-917d-3b6263a2043d req-dcf148a0-52af-4dd0-a34b-7fd41fb0d8e9 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b930e529-26b0-4928-917d-3b6263a2043d req-dcf148a0-52af-4dd0-a34b-7fd41fb0d8e9 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b930e529-26b0-4928-917d-3b6263a2043d req-dcf148a0-52af-4dd0-a34b-7fd41fb0d8e9 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-b930e529-26b0-4928-917d-3b6263a2043d req-dcf148a0-52af-4dd0-a34b-7fd41fb0d8e9 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:01 user nova-compute[72405]: WARNING nova.compute.manager [req-b930e529-26b0-4928-917d-3b6263a2043d req-dcf148a0-52af-4dd0-a34b-7fd41fb0d8e9 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c for instance with vm_state building and task_state spawning.
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-788df1ff-cbbf-4eb5-95cf-9db1a412258c req-15cf4508-7487-4591-a940-7dbfe4ef09ae service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-788df1ff-cbbf-4eb5-95cf-9db1a412258c req-15cf4508-7487-4591-a940-7dbfe4ef09ae service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-788df1ff-cbbf-4eb5-95cf-9db1a412258c req-15cf4508-7487-4591-a940-7dbfe4ef09ae service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-788df1ff-cbbf-4eb5-95cf-9db1a412258c req-15cf4508-7487-4591-a940-7dbfe4ef09ae service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-788df1ff-cbbf-4eb5-95cf-9db1a412258c req-15cf4508-7487-4591-a940-7dbfe4ef09ae service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:02 user nova-compute[72405]: WARNING nova.compute.manager [req-788df1ff-cbbf-4eb5-95cf-9db1a412258c req-15cf4508-7487-4591-a940-7dbfe4ef09ae service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b for instance with vm_state building and task_state spawning.
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-5966578b-bcda-437a-b687-3563c7ded13a req-db3e953d-92e1-4558-9fc9-fbbc60006581 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5966578b-bcda-437a-b687-3563c7ded13a req-db3e953d-92e1-4558-9fc9-fbbc60006581 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5966578b-bcda-437a-b687-3563c7ded13a req-db3e953d-92e1-4558-9fc9-fbbc60006581 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5966578b-bcda-437a-b687-3563c7ded13a req-db3e953d-92e1-4558-9fc9-fbbc60006581 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-5966578b-bcda-437a-b687-3563c7ded13a req-db3e953d-92e1-4558-9fc9-fbbc60006581 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:03 user nova-compute[72405]: WARNING nova.compute.manager [req-5966578b-bcda-437a-b687-3563c7ded13a req-db3e953d-92e1-4558-9fc9-fbbc60006581 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe for instance with vm_state building and task_state spawning.
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-5c93efd3-29ef-4287-9b8f-e3763d01498c req-8904cb88-1c1e-45d0-ab29-7275bf8b7431 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5c93efd3-29ef-4287-9b8f-e3763d01498c req-8904cb88-1c1e-45d0-ab29-7275bf8b7431 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5c93efd3-29ef-4287-9b8f-e3763d01498c req-8904cb88-1c1e-45d0-ab29-7275bf8b7431 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5c93efd3-29ef-4287-9b8f-e3763d01498c req-8904cb88-1c1e-45d0-ab29-7275bf8b7431 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-5c93efd3-29ef-4287-9b8f-e3763d01498c req-8904cb88-1c1e-45d0-ab29-7275bf8b7431 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:03 user nova-compute[72405]: WARNING nova.compute.manager [req-5c93efd3-29ef-4287-9b8f-e3763d01498c req-8904cb88-1c1e-45d0-ab29-7275bf8b7431 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c for instance with vm_state building and task_state spawning.
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid c072a4fb-12b6-41dd-ae55-fefa191c46c1 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:04 user nova-compute[72405]: WARNING nova.compute.manager [req-8413e5d9-f73b-4e83-821e-18f5ace277e8 req-9c605ef1-f947-45d8-a5ba-d487bdbe5c41 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 for instance with vm_state building and task_state spawning.
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537345.6290832, c072a4fb-12b6-41dd-ae55-fefa191c46c1 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] VM Resumed (Lifecycle Event)
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance spawned successfully.
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537345.6328151, c072a4fb-12b6-41dd-ae55-fefa191c46c1 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] VM Started (Lifecycle Event)
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Took 10.73 seconds to spawn the instance on the hypervisor.
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-9e10c26d-ddc5-45c0-86ed-791847e9cb99 req-dcf31d8b-eb57-448d-be18-0366668f4850 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9e10c26d-ddc5-45c0-86ed-791847e9cb99 req-dcf31d8b-eb57-448d-be18-0366668f4850 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9e10c26d-ddc5-45c0-86ed-791847e9cb99 req-dcf31d8b-eb57-448d-be18-0366668f4850 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9e10c26d-ddc5-45c0-86ed-791847e9cb99 req-dcf31d8b-eb57-448d-be18-0366668f4850 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-9e10c26d-ddc5-45c0-86ed-791847e9cb99 req-dcf31d8b-eb57-448d-be18-0366668f4850 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:05 user nova-compute[72405]: WARNING nova.compute.manager [req-9e10c26d-ddc5-45c0-86ed-791847e9cb99 req-dcf31d8b-eb57-448d-be18-0366668f4850 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe for instance with vm_state building and task_state spawning.
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Took 40.34 seconds to build instance.
Aug 08 23:29:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-713fa116-c65a-44be-97f2-ee591f79e49b tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.487s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.016s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:05 user nova-compute[72405]: INFO nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:06 user nova-compute[72405]: WARNING nova.compute.manager [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 for instance with vm_state active and task_state None.
Aug 08 23:29:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:06 user nova-compute[72405]: WARNING nova.compute.manager [req-1508b1ef-b71a-4ab7-8758-93ee65c5c9ef req-0345c1a5-df94-428c-b495-a3beb8593380 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 for instance with vm_state active and task_state None.
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:06 user nova-compute[72405]: INFO nova.compute.manager [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Terminating instance
Aug 08 23:29:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Instance destroyed successfully.
Aug 08 23:29:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lazy-loading 'resources' on Instance uuid 8fba4b8e-8a40-473a-9fc2-2d06ec128463 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-755080970',display_name='tempest-VolumesAdminNegativeTest-server-755080970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-755080970',id=7,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDga8EauNxj6yRwgLz83JXtJJtpPexB+kxhktsKSs7HyRqeeqkv8IbftH8byKyBQzLdF7vW0QNVfQmgsOsQVdhGs/PhZLu0dsFs3bRW1OGULHayQbH1rHN7bE921q5RjXA==',key_name='tempest-keypair-1061114838',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c2ac2c8f4474e83abe622858fe2fd1d',ramdisk_id='',reservation_id='r-0eu15v1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1763761892',owner_user_name='tempest-VolumesAdminNegativeTest-1763761892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d9d95793fbe40989729a80e72bde91d',uuid=8fba4b8e-8a40-473a-9fc2-2d06ec128463,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converting VIF {"id": "d3dc4ecd-2751-40aa-9424-b64b17934399", "address": "fa:16:3e:e6:0f:98", "network": {"id": "ebd5354f-7bb4-4264-b711-75201ad0ba09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1109900499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c2ac2c8f4474e83abe622858fe2fd1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4ecd-27", "ovs_interfaceid": "d3dc4ecd-2751-40aa-9424-b64b17934399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG os_vif [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3dc4ecd-27, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:07 user nova-compute[72405]: INFO os_vif [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:0f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4ecd-2751-40aa-9424-b64b17934399,network=Network(ebd5354f-7bb4-4264-b711-75201ad0ba09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc4ecd-27')
Aug 08 23:29:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Deleting instance files /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463_del
Aug 08 23:29:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Deletion of /opt/stack/data/nova/instances/8fba4b8e-8a40-473a-9fc2-2d06ec128463_del complete
Aug 08 23:29:07 user nova-compute[72405]: INFO nova.compute.manager [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 08 23:29:07 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:29:07 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-vif-unplugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] No waiting events found dispatching network-vif-unplugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-vif-unplugged-d3dc4ecd-2751-40aa-9424-b64b17934399 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] Acquiring lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] No waiting events found dispatching network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:08 user nova-compute[72405]: WARNING nova.compute.manager [req-bf5235ff-37b0-46c2-bf8a-2c9f072deb7f req-ae2aa52d-2f46-4e78-873f-8d0ed128b430 service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received unexpected event network-vif-plugged-d3dc4ecd-2751-40aa-9424-b64b17934399 for instance with vm_state active and task_state deleting.
Aug 08 23:29:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:08 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Took 1.03 seconds to deallocate network for instance.
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:09 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:29:09 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:29:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:09 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Deleted allocations for instance 8fba4b8e-8a40-473a-9fc2-2d06ec128463
Aug 08 23:29:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-44c8e1a7-7297-4823-838e-fb145ad0c956 tempest-VolumesAdminNegativeTest-1763761892 tempest-VolumesAdminNegativeTest-1763761892-project-member] Lock "8fba4b8e-8a40-473a-9fc2-2d06ec128463" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.592s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-995f87f3-4ca4-452c-a133-5f8ea94465c0 req-1dda6f8f-dff2-4f73-9f27-35d6f5fc2deb service nova] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Received event network-vif-deleted-d3dc4ecd-2751-40aa-9424-b64b17934399 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:21 user nova-compute[72405]: INFO nova.compute.manager [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Unrescuing
Aug 08 23:29:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:21 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537347.6656053, 8fba4b8e-8a40-473a-9fc2-2d06ec128463 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:22 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] VM Stopped (Lifecycle Event)
Aug 08 23:29:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b8de8f11-0e37-49bd-9962-a58d5e377ece None None] [instance: 8fba4b8e-8a40-473a-9fc2-2d06ec128463] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'flavor' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-508af39a-945a-456f-9edc-4950d37c8cda req-6e229555-4cc8-4798-903c-91afa1eb4d97 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-508af39a-945a-456f-9edc-4950d37c8cda req-6e229555-4cc8-4798-903c-91afa1eb4d97 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-508af39a-945a-456f-9edc-4950d37c8cda req-6e229555-4cc8-4798-903c-91afa1eb4d97 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-508af39a-945a-456f-9edc-4950d37c8cda req-6e229555-4cc8-4798-903c-91afa1eb4d97 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-508af39a-945a-456f-9edc-4950d37c8cda req-6e229555-4cc8-4798-903c-91afa1eb4d97 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:23 user nova-compute[72405]: WARNING nova.compute.manager [req-508af39a-945a-456f-9edc-4950d37c8cda req-6e229555-4cc8-4798-903c-91afa1eb4d97 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:29:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance destroyed successfully.
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:24 user nova-compute[72405]: INFO nova.compute.manager [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Terminating instance
Aug 08 23:29:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-c1a17167-9a14-4da9-b9cd-986f0fc84d4c req-98751943-e854-4fa3-bc0d-c8d9ed94924d service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c1a17167-9a14-4da9-b9cd-986f0fc84d4c req-98751943-e854-4fa3-bc0d-c8d9ed94924d service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c1a17167-9a14-4da9-b9cd-986f0fc84d4c req-98751943-e854-4fa3-bc0d-c8d9ed94924d service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c1a17167-9a14-4da9-b9cd-986f0fc84d4c req-98751943-e854-4fa3-bc0d-c8d9ed94924d service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-c1a17167-9a14-4da9-b9cd-986f0fc84d4c req-98751943-e854-4fa3-bc0d-c8d9ed94924d service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-c1a17167-9a14-4da9-b9cd-986f0fc84d4c req-98751943-e854-4fa3-bc0d-c8d9ed94924d service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-37ff55d4-1845-457b-947d-b6945eb7dd51 req-a0d0bf60-fcfa-4d46-9557-ceb64f097efb service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-37ff55d4-1845-457b-947d-b6945eb7dd51 req-a0d0bf60-fcfa-4d46-9557-ceb64f097efb service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-37ff55d4-1845-457b-947d-b6945eb7dd51 req-a0d0bf60-fcfa-4d46-9557-ceb64f097efb service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-37ff55d4-1845-457b-947d-b6945eb7dd51 req-a0d0bf60-fcfa-4d46-9557-ceb64f097efb service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-37ff55d4-1845-457b-947d-b6945eb7dd51 req-a0d0bf60-fcfa-4d46-9557-ceb64f097efb service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:25 user nova-compute[72405]: WARNING nova.compute.manager [req-37ff55d4-1845-457b-947d-b6945eb7dd51 req-a0d0bf60-fcfa-4d46-9557-ceb64f097efb service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Instance destroyed successfully.
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'resources' on Instance uuid 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1634977089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1634977089',id=5,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBT4Lyh9dl7ZNEvz9gDo3XYV4USF1K1eFewyehMSS7XV3yHhOoLkyg3N7NLRn9b+Wg3ImzdxmsasFpRmWm/DC/IQZPdxfY42D81mzjUYsH6M+17eIcBNI+h4OYTjCNGmQ==',key_name='tempest-keypair-380907040',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:27:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-ozqx2sck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=16d8b7a1-0c6b-444f-b17c-c64caa2ece8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "address": "fa:16:3e:61:fd:10", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a42571c-14", "ovs_interfaceid": "9a42571c-14a5-4457-b5f9-4a1de6ed2d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG os_vif [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a42571c-14, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:25 user nova-compute[72405]: INFO os_vif [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=9a42571c-14a5-4457-b5f9-4a1de6ed2d4d,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a42571c-14')
Aug 08 23:29:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Deleting instance files /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c_del
Aug 08 23:29:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Deletion of /opt/stack/data/nova/instances/16d8b7a1-0c6b-444f-b17c-c64caa2ece8c_del complete
Aug 08 23:29:25 user nova-compute[72405]: INFO nova.compute.manager [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 08 23:29:25 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:29:25 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:26 user nova-compute[72405]: WARNING nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state active and task_state deleting.
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:26 user nova-compute[72405]: WARNING nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state active and task_state deleting.
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:26 user nova-compute[72405]: WARNING nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state active and task_state deleting.
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-026ed8ae-c23e-4c0b-81ba-bf011e5609ed req-8fa06720-482a-4360-bb60-d27a37136c64 service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-unplugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:27 user nova-compute[72405]: WARNING nova.compute.manager [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:29:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:27 user nova-compute[72405]: WARNING nova.compute.manager [req-1e3e3c8b-53eb-4048-ba89-68124184cf60 req-52b8d120-bb71-450a-871f-1a2c5e6c6ae3 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:29:27 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:27 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Took 1.70 seconds to deallocate network for instance.
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 2adde477-61ea-4f06-a71d-86a3d94902f2 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537368.0890825, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Resumed (Lifecycle Event)
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bae4b888-f9c6-4d35-abbd-ce521e5c9833 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:28 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Deleted allocations for instance 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537368.0900064, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:28 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Started (Lifecycle Event)
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b228e74-be65-4ef0-aac1-16496a31c5e7 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.813s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] Acquiring lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] Lock "16d8b7a1-0c6b-444f-b17c-c64caa2ece8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] No waiting events found dispatching network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:28 user nova-compute[72405]: WARNING nova.compute.manager [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received unexpected event network-vif-plugged-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d for instance with vm_state deleted and task_state None.
Aug 08 23:29:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-2d246c95-f97d-4bf5-b698-e79bcacdbfac req-e1be4a43-729e-4e65-94fb-9e6352a85f0a service nova] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Received event network-vif-deleted-9a42571c-14a5-4457-b5f9-4a1de6ed2d4d {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:29:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:29:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-changed-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Refreshing instance network info cache due to event network-changed-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Refreshing network info cache for port f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updated VIF entry in instance network info cache for port f9f2e3cc-1e64-475b-9e4a-f1a0db25b771. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a150778-b46d-439f-a22e-c4db7eb5f0c2 req-c615dbb3-b86b-45b3-bfff-d16039fcc77e service nova] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:32 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:29:32 user nova-compute[72405]: INFO nova.compute.claims [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Claim successful on node user
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:29:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.policy [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8334edbf14ec382f6cd1c426703c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a146c9a0c224249ac3316e931874bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:29:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Creating image(s)
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.171s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk 1073741824" returned: 0 in 0.058s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:29:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.network.neutron [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Successfully created port: f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Cannot resize image /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'migration_context' on Instance uuid cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Ensure instance console log exists: /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG nova.network.neutron [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Successfully updated port: f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-changed-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Refreshing instance network info cache due to event network-changed-f7593a45-a32e-4150-ae32-f85caf5643c4. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] Acquiring lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] Acquired lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Refreshing network info cache for port f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1ee83aa6-cf33-4d5e-ad57-f9b4e92533bb req-6eedd8ef-64df-4a33-8e09-8d0d9e65dcd0 service nova] Releasing lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquired lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:35 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:29:35 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:29:35 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7561MB free_disk=25.52315902709961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 30ae278e-aa85-4896-84a1-a5301f5c5ccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance c072a4fb-12b6-41dd-ae55-fefa191c46c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance cc8aece0-15d7-4e9d-994a-3a2592246f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.network.neutron [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Updating instance_info_cache with network_info: [{"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Releasing lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Instance network_info: |[{"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Start _get_guest_xml network_info=[{"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:29:36 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:29:36 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303472658',display_name='tempest-AttachVolumeNegativeTest-server-303472658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303472658',id=22,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHE37yoHfn+Fj1noZuLsI9BlL3v0fuOwLzQh7mBAi/wQ+P3GdkaTiBtO/+JrQasKhr+xgJlDn/gQHoFUq+Eb9JErQXod9EBrxIzay5DqAtRdwM7am+haIJMjsB98OFc+w==',key_name='tempest-keypair-987998290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-iccfxfxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:29:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=cc8aece0-15d7-4e9d-994a-3a2592246f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.objects.instance [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'pci_devices' on Instance uuid cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:29:36 user nova-compute[72405]:   <uuid>cc8aece0-15d7-4e9d-994a-3a2592246f8a</uuid>
Aug 08 23:29:36 user nova-compute[72405]:   <name>instance-00000016</name>
Aug 08 23:29:36 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:29:36 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:29:36 user nova-compute[72405]:   <metadata>
Aug 08 23:29:36 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:29:36 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:29:36 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeNegativeTest-server-303472658</nova:name>
Aug 08 23:29:36 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:29:36</nova:creationTime>
Aug 08 23:29:36 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:29:36 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:29:36 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:29:36 user nova-compute[72405]:       <nova:owner>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:user uuid="5eb8334edbf14ec382f6cd1c426703c6">tempest-AttachVolumeNegativeTest-1663634564-project-member</nova:user>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:project uuid="4a146c9a0c224249ac3316e931874bc5">tempest-AttachVolumeNegativeTest-1663634564</nova:project>
Aug 08 23:29:36 user nova-compute[72405]:       </nova:owner>
Aug 08 23:29:36 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:29:36 user nova-compute[72405]:       <nova:ports>
Aug 08 23:29:36 user nova-compute[72405]:         <nova:port uuid="f7593a45-a32e-4150-ae32-f85caf5643c4">
Aug 08 23:29:36 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:29:36 user nova-compute[72405]:         </nova:port>
Aug 08 23:29:36 user nova-compute[72405]:       </nova:ports>
Aug 08 23:29:36 user nova-compute[72405]:     </nova:instance>
Aug 08 23:29:36 user nova-compute[72405]:   </metadata>
Aug 08 23:29:36 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:29:36 user nova-compute[72405]:     <system>
Aug 08 23:29:36 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:29:36 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:29:36 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:29:36 user nova-compute[72405]:       <entry name="serial">cc8aece0-15d7-4e9d-994a-3a2592246f8a</entry>
Aug 08 23:29:36 user nova-compute[72405]:       <entry name="uuid">cc8aece0-15d7-4e9d-994a-3a2592246f8a</entry>
Aug 08 23:29:36 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:29:36 user nova-compute[72405]:     </system>
Aug 08 23:29:36 user nova-compute[72405]:   </sysinfo>
Aug 08 23:29:36 user nova-compute[72405]:   <os>
Aug 08 23:29:36 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:29:36 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:29:36 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:29:36 user nova-compute[72405]:   </os>
Aug 08 23:29:36 user nova-compute[72405]:   <features>
Aug 08 23:29:36 user nova-compute[72405]:     <acpi/>
Aug 08 23:29:36 user nova-compute[72405]:     <apic/>
Aug 08 23:29:36 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:29:36 user nova-compute[72405]:   </features>
Aug 08 23:29:36 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:29:36 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:29:36 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:29:36 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:29:36 user nova-compute[72405]:   </clock>
Aug 08 23:29:36 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:29:36 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:29:36 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:29:36 user nova-compute[72405]:   </cpu>
Aug 08 23:29:36 user nova-compute[72405]:   <devices>
Aug 08 23:29:36 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:29:36 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:29:36 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk"/>
Aug 08 23:29:36 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:29:36 user nova-compute[72405]:     </disk>
Aug 08 23:29:36 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:29:36 user nova-compute[72405]:       <mac address="fa:16:3e:24:43:e2"/>
Aug 08 23:29:36 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:29:36 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:29:36 user nova-compute[72405]:       <target dev="tapf7593a45-a3"/>
Aug 08 23:29:36 user nova-compute[72405]:     </interface>
Aug 08 23:29:36 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:29:36 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/console.log" append="off"/>
Aug 08 23:29:36 user nova-compute[72405]:     </serial>
Aug 08 23:29:36 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:29:36 user nova-compute[72405]:     <video>
Aug 08 23:29:36 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:29:36 user nova-compute[72405]:     </video>
Aug 08 23:29:36 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:29:36 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:29:36 user nova-compute[72405]:     </rng>
Aug 08 23:29:36 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:29:36 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:29:36 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:29:36 user nova-compute[72405]:     </memballoon>
Aug 08 23:29:36 user nova-compute[72405]:   </devices>
Aug 08 23:29:36 user nova-compute[72405]: </domain>
Aug 08 23:29:36 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303472658',display_name='tempest-AttachVolumeNegativeTest-server-303472658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303472658',id=22,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHE37yoHfn+Fj1noZuLsI9BlL3v0fuOwLzQh7mBAi/wQ+P3GdkaTiBtO/+JrQasKhr+xgJlDn/gQHoFUq+Eb9JErQXod9EBrxIzay5DqAtRdwM7am+haIJMjsB98OFc+w==',key_name='tempest-keypair-987998290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-iccfxfxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:29:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=cc8aece0-15d7-4e9d-994a-3a2592246f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG os_vif [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7593a45-a3, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7593a45-a3, col_values=(('external_ids', {'iface-id': 'f7593a45-a32e-4150-ae32-f85caf5643c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:43:e2', 'vm-uuid': 'cc8aece0-15d7-4e9d-994a-3a2592246f8a'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:36 user nova-compute[72405]: INFO os_vif [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3')
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:24:43:e2, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:29:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-902fff0b-9977-47b1-8a93-ef9d845083ff req-f6e29f11-2eb6-412d-bbdc-75111e8b8c6b service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-902fff0b-9977-47b1-8a93-ef9d845083ff req-f6e29f11-2eb6-412d-bbdc-75111e8b8c6b service nova] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-902fff0b-9977-47b1-8a93-ef9d845083ff req-f6e29f11-2eb6-412d-bbdc-75111e8b8c6b service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-902fff0b-9977-47b1-8a93-ef9d845083ff req-f6e29f11-2eb6-412d-bbdc-75111e8b8c6b service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-902fff0b-9977-47b1-8a93-ef9d845083ff req-f6e29f11-2eb6-412d-bbdc-75111e8b8c6b service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] No waiting events found dispatching network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:38 user nova-compute[72405]: WARNING nova.compute.manager [req-902fff0b-9977-47b1-8a93-ef9d845083ff req-f6e29f11-2eb6-412d-bbdc-75111e8b8c6b service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received unexpected event network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 for instance with vm_state building and task_state spawning.
Aug 08 23:29:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537380.2299652, cc8aece0-15d7-4e9d-994a-3a2592246f8a => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] VM Resumed (Lifecycle Event)
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Instance spawned successfully.
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537380.238166, cc8aece0-15d7-4e9d-994a-3a2592246f8a => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] VM Started (Lifecycle Event)
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-96af61ba-a91d-4059-a65c-c2954a4a7009 req-388d4e50-e35e-419c-aacc-73b5be260984 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-96af61ba-a91d-4059-a65c-c2954a4a7009 req-388d4e50-e35e-419c-aacc-73b5be260984 service nova] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-96af61ba-a91d-4059-a65c-c2954a4a7009 req-388d4e50-e35e-419c-aacc-73b5be260984 service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-96af61ba-a91d-4059-a65c-c2954a4a7009 req-388d4e50-e35e-419c-aacc-73b5be260984 service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-96af61ba-a91d-4059-a65c-c2954a4a7009 req-388d4e50-e35e-419c-aacc-73b5be260984 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] No waiting events found dispatching network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:40 user nova-compute[72405]: WARNING nova.compute.manager [req-96af61ba-a91d-4059-a65c-c2954a4a7009 req-388d4e50-e35e-419c-aacc-73b5be260984 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received unexpected event network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 for instance with vm_state building and task_state spawning.
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Took 7.77 seconds to build instance.
Aug 08 23:29:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-43b5b555-d14a-4e5e-8745-0509d172832b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.868s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537365.7100117, 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:40 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] VM Stopped (Lifecycle Event)
Aug 08 23:29:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9be0ad07-28e8-4e4a-bbe2-65e1753ae445 None None] [instance: 16d8b7a1-0c6b-444f-b17c-c64caa2ece8c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing instance network info cache due to event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:44 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:29:44 user nova-compute[72405]: INFO nova.compute.claims [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Claim successful on node user
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updated VIF entry in instance network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aa5fbc55-6a77-4d6e-b759-95310449772a req-783c9e72-4132-44d7-a769-7b9cdd4d8248 service nova] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:29:45 user nova-compute[72405]: INFO nova.compute.manager [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] instance snapshotting
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:29:45 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Beginning live snapshot process
Aug 08 23:29:45 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.policy [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a44d888f97048c9b47154e7700bb9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9333fa38e4335ae6b2eabc3a579c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:29:45 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Creating image(s)
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "/opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "/opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "/opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json -f qcow2" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.168s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk 1073741824" returned: 0 in 0.093s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing instance network info cache due to event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4f__tund/63e582d14ece486ebe6074a995f52cec.delta 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4f__tund/63e582d14ece486ebe6074a995f52cec.delta 1073741824" returned: 0 in 0.090s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Cannot resize image /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.objects.instance [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'migration_context' on Instance uuid 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Ensure instance console log exists: /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:46 user nova-compute[72405]: INFO nova.compute.manager [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Shelve offloading
Aug 08 23:29:46 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Successfully created port: 3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG nova.network.neutron [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updated VIF entry in instance network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG nova.network.neutron [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c8ed8bdb-1d7f-4aa6-b75f-16bb437f9146 req-d2133f51-3da3-4e5a-b4f8-b449a921080d service nova] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] COPY block job progress, current cursor: 19857408 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:29:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance destroyed successfully.
Aug 08 23:29:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:47 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-unplugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-unplugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:48 user nova-compute[72405]: WARNING nova.compute.manager [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-unplugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state active and task_state shelving.
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:48 user nova-compute[72405]: WARNING nova.compute.manager [req-62c860e8-164b-4684-bdb2-4b04003885d0 req-3ddf35a3-b160-493d-a3a9-3cae28521496 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state active and task_state shelving.
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:29:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Successfully updated port: 3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquired lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4f__tund/63e582d14ece486ebe6074a995f52cec.delta /opt/stack/data/nova/instances/snapshots/tmp4f__tund/63e582d14ece486ebe6074a995f52cec {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-changed-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Refreshing instance network info cache due to event network-changed-3f28230e-aa3c-4173-8904-fa38542e2554. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] Acquiring lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4f__tund/63e582d14ece486ebe6074a995f52cec.delta /opt/stack/data/nova/instances/snapshots/tmp4f__tund/63e582d14ece486ebe6074a995f52cec" returned: 0 in 0.637s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Snapshot extracted, beginning image upload
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updating instance_info_cache with network_info: [{"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Releasing lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Instance network_info: |[{"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] Acquired lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.neutron [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Refreshing network info cache for port 3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Start _get_guest_xml network_info=[{"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:29:49 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:29:49 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-985242216',display_name='tempest-VolumesSnapshotTestJSON-instance-985242216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-985242216',id=23,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdvP+LBbAV1KZ4laNfMtAUScmNbsYPwCsZwz5asSfj9IYTgZhu+pY/M0NjjOIIR1YpOq54uC1DEZ7rIVDIvh1FZEVjLt6yKGNj1JoD/Iku486GUXj04oJunyqG7+jr2ug==',key_name='tempest-keypair-2090972308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75e9333fa38e4335ae6b2eabc3a579c0',ramdisk_id='',reservation_id='r-eop4hfu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1813381307',owner_user_name='tempest-VolumesSnapshotTestJSON-1813381307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:29:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a44d888f97048c9b47154e7700bb9fa',uuid=466645d2-64fb-4c97-899a-1997a0ef4bca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converting VIF {"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.objects.instance [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'pci_devices' on Instance uuid 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:29:49 user nova-compute[72405]:   <uuid>466645d2-64fb-4c97-899a-1997a0ef4bca</uuid>
Aug 08 23:29:49 user nova-compute[72405]:   <name>instance-00000017</name>
Aug 08 23:29:49 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:29:49 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:29:49 user nova-compute[72405]:   <metadata>
Aug 08 23:29:49 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:29:49 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:29:49 user nova-compute[72405]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-985242216</nova:name>
Aug 08 23:29:49 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:29:49</nova:creationTime>
Aug 08 23:29:49 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:29:49 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:29:49 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:29:49 user nova-compute[72405]:       <nova:owner>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:user uuid="0a44d888f97048c9b47154e7700bb9fa">tempest-VolumesSnapshotTestJSON-1813381307-project-member</nova:user>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:project uuid="75e9333fa38e4335ae6b2eabc3a579c0">tempest-VolumesSnapshotTestJSON-1813381307</nova:project>
Aug 08 23:29:49 user nova-compute[72405]:       </nova:owner>
Aug 08 23:29:49 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:29:49 user nova-compute[72405]:       <nova:ports>
Aug 08 23:29:49 user nova-compute[72405]:         <nova:port uuid="3f28230e-aa3c-4173-8904-fa38542e2554">
Aug 08 23:29:49 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:29:49 user nova-compute[72405]:         </nova:port>
Aug 08 23:29:49 user nova-compute[72405]:       </nova:ports>
Aug 08 23:29:49 user nova-compute[72405]:     </nova:instance>
Aug 08 23:29:49 user nova-compute[72405]:   </metadata>
Aug 08 23:29:49 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:29:49 user nova-compute[72405]:     <system>
Aug 08 23:29:49 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:29:49 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:29:49 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:29:49 user nova-compute[72405]:       <entry name="serial">466645d2-64fb-4c97-899a-1997a0ef4bca</entry>
Aug 08 23:29:49 user nova-compute[72405]:       <entry name="uuid">466645d2-64fb-4c97-899a-1997a0ef4bca</entry>
Aug 08 23:29:49 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:29:49 user nova-compute[72405]:     </system>
Aug 08 23:29:49 user nova-compute[72405]:   </sysinfo>
Aug 08 23:29:49 user nova-compute[72405]:   <os>
Aug 08 23:29:49 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:29:49 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:29:49 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:29:49 user nova-compute[72405]:   </os>
Aug 08 23:29:49 user nova-compute[72405]:   <features>
Aug 08 23:29:49 user nova-compute[72405]:     <acpi/>
Aug 08 23:29:49 user nova-compute[72405]:     <apic/>
Aug 08 23:29:49 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:29:49 user nova-compute[72405]:   </features>
Aug 08 23:29:49 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:29:49 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:29:49 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:29:49 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:29:49 user nova-compute[72405]:   </clock>
Aug 08 23:29:49 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:29:49 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:29:49 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:29:49 user nova-compute[72405]:   </cpu>
Aug 08 23:29:49 user nova-compute[72405]:   <devices>
Aug 08 23:29:49 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:29:49 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:29:49 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk"/>
Aug 08 23:29:49 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:29:49 user nova-compute[72405]:     </disk>
Aug 08 23:29:49 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:29:49 user nova-compute[72405]:       <mac address="fa:16:3e:e5:34:56"/>
Aug 08 23:29:49 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:29:49 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:29:49 user nova-compute[72405]:       <target dev="tap3f28230e-aa"/>
Aug 08 23:29:49 user nova-compute[72405]:     </interface>
Aug 08 23:29:49 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:29:49 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/console.log" append="off"/>
Aug 08 23:29:49 user nova-compute[72405]:     </serial>
Aug 08 23:29:49 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:29:49 user nova-compute[72405]:     <video>
Aug 08 23:29:49 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:29:49 user nova-compute[72405]:     </video>
Aug 08 23:29:49 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:29:49 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:29:49 user nova-compute[72405]:     </rng>
Aug 08 23:29:49 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:29:49 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:29:49 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:29:49 user nova-compute[72405]:     </memballoon>
Aug 08 23:29:49 user nova-compute[72405]:   </devices>
Aug 08 23:29:49 user nova-compute[72405]: </domain>
Aug 08 23:29:49 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-985242216',display_name='tempest-VolumesSnapshotTestJSON-instance-985242216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-985242216',id=23,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdvP+LBbAV1KZ4laNfMtAUScmNbsYPwCsZwz5asSfj9IYTgZhu+pY/M0NjjOIIR1YpOq54uC1DEZ7rIVDIvh1FZEVjLt6yKGNj1JoD/Iku486GUXj04oJunyqG7+jr2ug==',key_name='tempest-keypair-2090972308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75e9333fa38e4335ae6b2eabc3a579c0',ramdisk_id='',reservation_id='r-eop4hfu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1813381307',owner_user_name='tempest-VolumesSnapshotTestJSON-1813381307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:29:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a44d888f97048c9b47154e7700bb9fa',uuid=466645d2-64fb-4c97-899a-1997a0ef4bca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converting VIF {"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_vif [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f28230e-aa, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f28230e-aa, col_values=(('external_ids', {'iface-id': '3f28230e-aa3c-4173-8904-fa38542e2554', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:34:56', 'vm-uuid': '466645d2-64fb-4c97-899a-1997a0ef4bca'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: INFO os_vif [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa')
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No VIF found with MAC fa:16:3e:e5:34:56, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:29:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance destroyed successfully.
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'resources' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1879559594',display_name='tempest-TestShelveInstance-server-1879559594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1879559594',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMQPbmgGwiwmfcSvnP4zk8kB/DIa6fkpGy/NXzZIly5roH+tc7tcLgZFTKtcUNuntPXCRUUJ+w5Mz4sfHrTkcoyXwF37gSP0OmzMumpwGfmFJbaJhlfCRbBueeZSay3eg==',key_name='tempest-TestShelveInstance-350639281',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d232f86412044a58663caf23a71cc3b',ramdisk_id='',reservation_id='r-wt4dngfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1642333906',owner_user_name='tempest-TestShelveInstance-1642333906-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:28:11Z,user_data=None,user_id='3e3c4d0e349b49f0ac2151b1bcb1af87',uuid=30ae278e-aa85-4896-84a1-a5301f5c5ccd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converting VIF {"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_vif [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bc5f924-bc, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:49 user nova-compute[72405]: INFO os_vif [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc')
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:29:49 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b8f850-045c-4ccb-b521-c5953908c82d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bedf490-8f9d-4f8d-a3a2-aad5c044b5fc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:29:49 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:29:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb7851d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.neutron [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updated VIF entry in instance network info cache for port 3f28230e-aa3c-4173-8904-fa38542e2554. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG nova.network.neutron [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updating instance_info_cache with network_info: [{"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0121c0e3-a538-483e-b48b-4475f3c61acb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-135fe7cf-1bcf-4ff6-8a8a-fe0a20d895f3 req-af1e3842-9823-45e0-892a-e072d3dc1f5d service nova] Releasing lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a90f2-25cf-4f1a-9f38-a642925d2717]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0098c73b-9ac5-4263-80d9-5623c9e42e51]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18bfb47-aa07-4e03-af44-2ce2fadbd921]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47a3dc-e1fb-4e73-9fed-76c88b878f1b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2557ebab-083e-4fb4-ad60-4cae93245776]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]
Aug 08 23:29:49 user nova-compute[72405]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.
Aug 08 23:29:49 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:29:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[541e020c-6502-4922-b684-2f7bca500f2a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] <== disconnect_volume: return (328ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:29:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Deleting instance files /opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd_del
Aug 08 23:29:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Deletion of /opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd_del complete
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing instance network info cache due to event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-50cea05c-658b-4255-b82d-79ee38f7fc16 req-889dfe3a-e4d6-40c1-8653-9552f54995a5 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-50cea05c-658b-4255-b82d-79ee38f7fc16 req-889dfe3a-e4d6-40c1-8653-9552f54995a5 service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-50cea05c-658b-4255-b82d-79ee38f7fc16 req-889dfe3a-e4d6-40c1-8653-9552f54995a5 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-50cea05c-658b-4255-b82d-79ee38f7fc16 req-889dfe3a-e4d6-40c1-8653-9552f54995a5 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-50cea05c-658b-4255-b82d-79ee38f7fc16 req-889dfe3a-e4d6-40c1-8653-9552f54995a5 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:50 user nova-compute[72405]: WARNING nova.compute.manager [req-50cea05c-658b-4255-b82d-79ee38f7fc16 req-889dfe3a-e4d6-40c1-8653-9552f54995a5 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received unexpected event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with vm_state building and task_state spawning.
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updated VIF entry in instance network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:29:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": null, "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68af55de-652d-4701-9a89-18e91c8d9608 req-c67b5622-124c-4e1f-82a6-71146ede8985 service nova] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:29:51 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Deleted allocations for instance 30ae278e-aa85-4896-84a1-a5301f5c5ccd
Aug 08 23:29:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'numa_topology' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:29:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Snapshot image upload complete
Aug 08 23:29:51 user nova-compute[72405]: INFO nova.compute.manager [None req-c9c935ab-9ebc-4446-a686-59130a4d9944 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Took 6.38 seconds to snapshot the instance on the hypervisor.
Aug 08 23:29:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8298adb-bc4d-445a-b98e-6e967fccf4dd tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.988s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-8996c69f-24b6-412d-994c-2d2fec37aaea req-a42f862e-9628-41e9-8314-781854c82c3d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8996c69f-24b6-412d-994c-2d2fec37aaea req-a42f862e-9628-41e9-8314-781854c82c3d service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8996c69f-24b6-412d-994c-2d2fec37aaea req-a42f862e-9628-41e9-8314-781854c82c3d service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8996c69f-24b6-412d-994c-2d2fec37aaea req-a42f862e-9628-41e9-8314-781854c82c3d service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-8996c69f-24b6-412d-994c-2d2fec37aaea req-a42f862e-9628-41e9-8314-781854c82c3d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:29:52 user nova-compute[72405]: WARNING nova.compute.manager [req-8996c69f-24b6-412d-994c-2d2fec37aaea req-a42f862e-9628-41e9-8314-781854c82c3d service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received unexpected event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with vm_state building and task_state spawning.
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537392.9107478, 466645d2-64fb-4c97-899a-1997a0ef4bca => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:52 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] VM Resumed (Lifecycle Event)
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:29:52 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Instance spawned successfully.
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:29:52 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537392.9114208, 466645d2-64fb-4c97-899a-1997a0ef4bca => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:29:52 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] VM Started (Lifecycle Event)
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:29:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:29:53 user nova-compute[72405]: INFO nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Took 7.29 seconds to spawn the instance on the hypervisor.
Aug 08 23:29:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:29:53 user nova-compute[72405]: INFO nova.compute.manager [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Took 8.23 seconds to build instance.
Aug 08 23:29:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d3cbe6c-595e-4b20-aea8-4842c37833c2 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.366s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:29:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:29:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:02 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537387.780261, 30ae278e-aa85-4896-84a1-a5301f5c5ccd => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:30:02 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] VM Stopped (Lifecycle Event)
Aug 08 23:30:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6d9372ca-cc4e-4f0a-aec6-944c5259cd57 None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-changed-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing instance network info cache due to event network-changed-9d662e25-ca05-4576-afb5-96314a853b4c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:30:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] Acquiring lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:30:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] Acquired lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:30:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Refreshing network info cache for port 9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:30:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updated VIF entry in instance network info cache for port 9d662e25-ca05-4576-afb5-96314a853b4c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:30:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bc24325a-97df-494a-9cc1-bc7ff25dc284 req-badf8263-4606-4db4-9b78-c1bfa13e2417 service nova] Releasing lock "refresh_cache-c072a4fb-12b6-41dd-ae55-fefa191c46c1" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:30:18 user nova-compute[72405]: INFO nova.compute.claims [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Claim successful on node user
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:18 user nova-compute[72405]: INFO nova.compute.manager [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Terminating instance
Aug 08 23:30:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-changed-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Refreshing instance network info cache due to event network-changed-eac5523e-985c-4a32-b6a6-b75f08a00cf9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.network.neutron [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Refreshing network info cache for port eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:30:19 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dd45709-289f-4817-9a88-e814455f65f4 req-e93ecef4-6b99-49c3-81a2-a7e8ddd058c7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dd45709-289f-4817-9a88-e814455f65f4 req-e93ecef4-6b99-49c3-81a2-a7e8ddd058c7 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dd45709-289f-4817-9a88-e814455f65f4 req-e93ecef4-6b99-49c3-81a2-a7e8ddd058c7 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dd45709-289f-4817-9a88-e814455f65f4 req-e93ecef4-6b99-49c3-81a2-a7e8ddd058c7 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dd45709-289f-4817-9a88-e814455f65f4 req-e93ecef4-6b99-49c3-81a2-a7e8ddd058c7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dd45709-289f-4817-9a88-e814455f65f4 req-e93ecef4-6b99-49c3-81a2-a7e8ddd058c7 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:30:19 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Creating image(s)
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.policy [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb25719ffe4c467e8afc3f6b8fe4d712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6dc799f1b4698b15a3ea91c8dbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-316dbed0-9360-482b-ba8d-e8bd551049fd req-08c1f7e8-267f-4a1f-8971-c6c9a972c0fd service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-316dbed0-9360-482b-ba8d-e8bd551049fd req-08c1f7e8-267f-4a1f-8971-c6c9a972c0fd service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-316dbed0-9360-482b-ba8d-e8bd551049fd req-08c1f7e8-267f-4a1f-8971-c6c9a972c0fd service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-316dbed0-9360-482b-ba8d-e8bd551049fd req-08c1f7e8-267f-4a1f-8971-c6c9a972c0fd service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-316dbed0-9360-482b-ba8d-e8bd551049fd req-08c1f7e8-267f-4a1f-8971-c6c9a972c0fd service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-316dbed0-9360-482b-ba8d-e8bd551049fd req-08c1f7e8-267f-4a1f-8971-c6c9a972c0fd service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk 1073741824" returned: 0 in 0.073s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Cannot resize image /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'migration_context' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Ensure instance console log exists: /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Instance destroyed successfully.
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lazy-loading 'resources' on Instance uuid c072a4fb-12b6-41dd-ae55-fefa191c46c1 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d662e25-ca, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:90:ae,bridge_name='br-int',has_traffic_filtering=True,id=9d662e25-ca05-4576-afb5-96314a853b4c,network=Network(2bff0f31-62c6-4e8f-98c5-fda295f63eea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d662e25-ca')
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c07f90-37, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c07f90-37b9-44a7-a5be-2dfcfb8c431b,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7c07f90-37')
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15730843-12, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-9d662e25-ca05-4576-afb5-96314a853b4c for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:21 user nova-compute[72405]: WARNING nova.compute.manager [req-9248d998-c5c3-4b4a-be0b-11aae9e599dd req-8c5b60c1-f6f5-41d2-bd3e-709793d663c4 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-9d662e25-ca05-4576-afb5-96314a853b4c for instance with vm_state active and task_state deleting.
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.neutron [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updated VIF entry in instance network info cache for port eac5523e-985c-4a32-b6a6-b75f08a00cf9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.neutron [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2b075fea-3c04-40d7-b884-09188810862e req-00be7027-2d33-47cf-9095-8576b513e917 service nova] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:28,bridge_name='br-int',has_traffic_filtering=True,id=15730843-12df-450c-a0ba-6b35564e526f,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15730843-12')
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "d87ef898-e971-4f53-9983-08d9f93a9e84", "address": "fa:16:3e:b8:fb:e9", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87ef898-e9", "ovs_interfaceid": "d87ef898-e971-4f53-9983-08d9f93a9e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd87ef898-e9, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fb:e9,bridge_name='br-int',has_traffic_filtering=True,id=d87ef898-e971-4f53-9983-08d9f93a9e84,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87ef898-e9')
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8940fbb3-e6, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:04:ce,bridge_name='br-int',has_traffic_filtering=True,id=8940fbb3-e675-4b99-abe3-e78516ccdd08,network=Network(68788d50-afd3-4ddc-aff4-ef4c510ed77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8940fbb3-e6')
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbacf45ab-5e, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf45ab-5e')
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-08T23:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144567651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144567651',id=20,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE2g8UaRwYdapVrKMCqYiI6tzITQud6tG+MBjSDFyfMozbTU5PVs4LZ2Kljm9YhQCEz+Kk7EXGWGPnVBXkEjUoZXrjF/6pUQUGMU1GC9ThIWpgYr8Nn0KlhYMAX3zXKIw==',key_name='tempest-keypair-312780600',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3e83aa1a58c4be78275fb938dd39ac8',ramdisk_id='',reservation_id='r-re003bj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1744341241',owner_user_name='tempest-TaggedBootDevicesTest_v242-1744341241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='437d3dd1e1484bf5b5bf0c05cacc1782',uuid=c072a4fb-12b6-41dd-ae55-fefa191c46c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converting VIF {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8f79854-a8, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:21 user nova-compute[72405]: INFO os_vif [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=d8f79854-a86d-4032-bc96-002ec5ef3dfe,network=Network(fac1aea2-050c-44fb-bcdd-3e084f5f66d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f79854-a8')
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mixhzoMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:30:21 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c564b71-9ac0-45a9-90a7-9170f510c00a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14478ac9-947c-49a0-8487-5f18ca2fcc11]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f3eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf54c68-0fe4-4917-b023-7d4d848a57b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5209b5b6-f93e-4da1-b1eb-7b5fb370db61]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b7c5f-822d-49dd-8003-ee0c8339fc06]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12964588-874a-494a-ad58-77b4281db4a6]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b01ee8-41e8-4b71-8731-dbd931b1cc62]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5d2dc-6ccf-4a0d-913a-929d396232c2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260]
Aug 08 23:30:21 user nova-compute[72405]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239, portal: 172.16.0.220,3260] successful.
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dec97cf5-134c-4d8c-aefd-400b4e5a2239 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5cdc6-470e-4df7-9fd0-5e5a3f400bbd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== disconnect_volume: return (311ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QznjAFHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:30:21 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3704708b-5775-430f-8411-eaad25fbf1cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[00251d10-4e7b-465a-82de-fa5edf613235]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54fbeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[99160ff6-a342-45d6-9e7e-6316ded63f68]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e175dab-a01b-4f33-8633-19ba0946f428]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[868398e1-5f78-482f-8102-512aca633b7e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[162550be-3691-4486-9a41-4ba8671f783f]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9f71ac-c8b1-4af9-b928-68e255a6cc47]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:21 user nova-compute[72405]: WARNING nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-b7c07f90-37b9-44a7-a5be-2dfcfb8c431b for instance with vm_state active and task_state deleting.
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-15730843-12df-450c-a0ba-6b35564e526f for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:21 user nova-compute[72405]: WARNING nova.compute.manager [req-c29ba4dc-4079-408b-b6b0-4c59b01a8dcd req-d74102ee-f779-4b44-b91e-a04c44557fb6 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-15730843-12df-450c-a0ba-6b35564e526f for instance with vm_state active and task_state deleting.
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3876c-28e8-4438-86cb-cabf7684e1c9]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260]
Aug 08 23:30:21 user nova-compute[72405]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b, portal: 172.16.0.220,3260] successful.
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d99145-7be3-488e-9149-8c4521c0748b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd631eab-c3d2-4ec4-866c-9dcbce59ef4b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== disconnect_volume: return (327ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAYxZGak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:30:21 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f2ae0-9921-4e1c-9f35-addd1cdb8bbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[be066484-5ba6-4ebb-ae10-4e85cb079a72]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 (non-flash)
Aug 08 23:30:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54fbeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2'): ({'sdf'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Removing single pathed devices sdf {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d293d6a-4786-4111-80ac-1841d87ed48c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[198607ed-4a39-4a29-a646-2796c8513b34]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Flushing IO for device /dev/sdf {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf1cf2c-0e26-4202-83a2-891b6d89fc70]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Successfully created port: 418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44e1c98-efd0-45f1-ba3b-789ce76288d0]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7515837f-2f6e-4eb1-8cd7-c366656a53e4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29f83b6-8672-488d-9f0e-3e21cf62e5ae]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260]
Aug 08 23:30:22 user nova-compute[72405]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2, portal: 172.16.0.220,3260] successful.
Aug 08 23:30:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b205aa-4e5d-473f-9c3b-ff419fea7ac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e214ff9d-1326-41f0-a851-2a1fbb439596]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] <== disconnect_volume: return (271ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:30:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Deleting instance files /opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1_del
Aug 08 23:30:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Deletion of /opt/stack/data/nova/instances/c072a4fb-12b6-41dd-ae55-fefa191c46c1_del complete
Aug 08 23:30:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-b49b634c-64be-4e93-8c5e-9fe70731a6a2 req-f5dfdfbb-5307-437a-8c59-9a0e4d8f972b service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b49b634c-64be-4e93-8c5e-9fe70731a6a2 req-f5dfdfbb-5307-437a-8c59-9a0e4d8f972b service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b49b634c-64be-4e93-8c5e-9fe70731a6a2 req-f5dfdfbb-5307-437a-8c59-9a0e4d8f972b service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b49b634c-64be-4e93-8c5e-9fe70731a6a2 req-f5dfdfbb-5307-437a-8c59-9a0e4d8f972b service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-b49b634c-64be-4e93-8c5e-9fe70731a6a2 req-f5dfdfbb-5307-437a-8c59-9a0e4d8f972b service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:22 user nova-compute[72405]: WARNING nova.compute.manager [req-b49b634c-64be-4e93-8c5e-9fe70731a6a2 req-f5dfdfbb-5307-437a-8c59-9a0e4d8f972b service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-d8f79854-a86d-4032-bc96-002ec5ef3dfe for instance with vm_state active and task_state deleting.
Aug 08 23:30:22 user nova-compute[72405]: INFO nova.compute.manager [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Took 3.29 seconds to destroy the instance on the hypervisor.
Aug 08 23:30:22 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:30:22 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-d87ef898-e971-4f53-9983-08d9f93a9e84 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:23 user nova-compute[72405]: WARNING nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-d87ef898-e971-4f53-9983-08d9f93a9e84 for instance with vm_state active and task_state deleting.
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-e1d0d90c-adf2-4479-b36c-71ba3dd8d053 req-95dd7a35-a5e2-47d4-95a9-140bbb66d812 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:24 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Successfully updated port: 418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:30:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:30:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:30:24 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance network_info: |[{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Start _get_guest_xml network_info=[{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:30:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:30:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330613417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330613417',id=24,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZrgB0t8FyEc9XDJAEVKchd2UHxZI2ndPwoMOm/H4NoEIISPQHebEz1f8EBd0SrxcatAlMw7TVzErTi2xbmATOuOsUFaBACHBYZ8KKF/5KEAQ8mhYCsUoodnumvFPn70g==',key_name='tempest-keypair-779216247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-gjwgg0im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=3ff81abc-acf0-4d6e-b88b-3db62c9f9080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:30:25 user nova-compute[72405]:   <uuid>3ff81abc-acf0-4d6e-b88b-3db62c9f9080</uuid>
Aug 08 23:30:25 user nova-compute[72405]:   <name>instance-00000018</name>
Aug 08 23:30:25 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:30:25 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:30:25 user nova-compute[72405]:   <metadata>
Aug 08 23:30:25 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:30:25 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:30:25 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1330613417</nova:name>
Aug 08 23:30:25 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:30:25</nova:creationTime>
Aug 08 23:30:25 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:30:25 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:30:25 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:30:25 user nova-compute[72405]:       <nova:owner>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:user uuid="fb25719ffe4c467e8afc3f6b8fe4d712">tempest-AttachVolumeShelveTestJSON-1695202964-project-member</nova:user>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:project uuid="94f6dc799f1b4698b15a3ea91c8dbea9">tempest-AttachVolumeShelveTestJSON-1695202964</nova:project>
Aug 08 23:30:25 user nova-compute[72405]:       </nova:owner>
Aug 08 23:30:25 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:30:25 user nova-compute[72405]:       <nova:ports>
Aug 08 23:30:25 user nova-compute[72405]:         <nova:port uuid="418e6ca5-f552-4992-b7e5-26daea416207">
Aug 08 23:30:25 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 08 23:30:25 user nova-compute[72405]:         </nova:port>
Aug 08 23:30:25 user nova-compute[72405]:       </nova:ports>
Aug 08 23:30:25 user nova-compute[72405]:     </nova:instance>
Aug 08 23:30:25 user nova-compute[72405]:   </metadata>
Aug 08 23:30:25 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:30:25 user nova-compute[72405]:     <system>
Aug 08 23:30:25 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:30:25 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:30:25 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:30:25 user nova-compute[72405]:       <entry name="serial">3ff81abc-acf0-4d6e-b88b-3db62c9f9080</entry>
Aug 08 23:30:25 user nova-compute[72405]:       <entry name="uuid">3ff81abc-acf0-4d6e-b88b-3db62c9f9080</entry>
Aug 08 23:30:25 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:30:25 user nova-compute[72405]:     </system>
Aug 08 23:30:25 user nova-compute[72405]:   </sysinfo>
Aug 08 23:30:25 user nova-compute[72405]:   <os>
Aug 08 23:30:25 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:30:25 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:30:25 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:30:25 user nova-compute[72405]:   </os>
Aug 08 23:30:25 user nova-compute[72405]:   <features>
Aug 08 23:30:25 user nova-compute[72405]:     <acpi/>
Aug 08 23:30:25 user nova-compute[72405]:     <apic/>
Aug 08 23:30:25 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:30:25 user nova-compute[72405]:   </features>
Aug 08 23:30:25 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:30:25 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:30:25 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:30:25 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:30:25 user nova-compute[72405]:   </clock>
Aug 08 23:30:25 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:30:25 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:30:25 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:30:25 user nova-compute[72405]:   </cpu>
Aug 08 23:30:25 user nova-compute[72405]:   <devices>
Aug 08 23:30:25 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:30:25 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:30:25 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk"/>
Aug 08 23:30:25 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:30:25 user nova-compute[72405]:     </disk>
Aug 08 23:30:25 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:30:25 user nova-compute[72405]:       <mac address="fa:16:3e:6c:3b:64"/>
Aug 08 23:30:25 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:30:25 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:30:25 user nova-compute[72405]:       <target dev="tap418e6ca5-f5"/>
Aug 08 23:30:25 user nova-compute[72405]:     </interface>
Aug 08 23:30:25 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:30:25 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/console.log" append="off"/>
Aug 08 23:30:25 user nova-compute[72405]:     </serial>
Aug 08 23:30:25 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:30:25 user nova-compute[72405]:     <video>
Aug 08 23:30:25 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:30:25 user nova-compute[72405]:     </video>
Aug 08 23:30:25 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:30:25 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:30:25 user nova-compute[72405]:     </rng>
Aug 08 23:30:25 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:30:25 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:30:25 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:30:25 user nova-compute[72405]:     </memballoon>
Aug 08 23:30:25 user nova-compute[72405]:   </devices>
Aug 08 23:30:25 user nova-compute[72405]: </domain>
Aug 08 23:30:25 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330613417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330613417',id=24,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZrgB0t8FyEc9XDJAEVKchd2UHxZI2ndPwoMOm/H4NoEIISPQHebEz1f8EBd0SrxcatAlMw7TVzErTi2xbmATOuOsUFaBACHBYZ8KKF/5KEAQ8mhYCsUoodnumvFPn70g==',key_name='tempest-keypair-779216247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-gjwgg0im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=3ff81abc-acf0-4d6e-b88b-3db62c9f9080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG os_vif [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap418e6ca5-f5, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap418e6ca5-f5, col_values=(('external_ids', {'iface-id': '418e6ca5-f552-4992-b7e5-26daea416207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:3b:64', 'vm-uuid': '3ff81abc-acf0-4d6e-b88b-3db62c9f9080'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:25 user nova-compute[72405]: INFO os_vif [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5')
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No VIF found with MAC fa:16:3e:6c:3b:64, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:25 user nova-compute[72405]: WARNING nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-8940fbb3-e675-4b99-abe3-e78516ccdd08 for instance with vm_state active and task_state deleting.
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-changed-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing instance network info cache due to event network-changed-418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:30:25 user nova-compute[72405]: DEBUG nova.network.neutron [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.network.neutron [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updated VIF entry in instance network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.network.neutron [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-unplugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-unplugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Acquiring lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] No waiting events found dispatching network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:26 user nova-compute[72405]: WARNING nova.compute.manager [req-02bce4ba-0f8c-4c6e-9f76-32513ce9ce8e req-46eed4fd-ce27-4adb-b6b8-c33c5813ff65 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received unexpected event network-vif-plugged-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 for instance with vm_state active and task_state deleting.
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'info_cache' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-7516f21a-64db-4076-8287-50fc926b5883 req-7c1eb1fb-9b88-4062-9e35-81e82e41cafd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7516f21a-64db-4076-8287-50fc926b5883 req-7c1eb1fb-9b88-4062-9e35-81e82e41cafd service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7516f21a-64db-4076-8287-50fc926b5883 req-7c1eb1fb-9b88-4062-9e35-81e82e41cafd service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7516f21a-64db-4076-8287-50fc926b5883 req-7c1eb1fb-9b88-4062-9e35-81e82e41cafd service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-7516f21a-64db-4076-8287-50fc926b5883 req-7c1eb1fb-9b88-4062-9e35-81e82e41cafd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:27 user nova-compute[72405]: WARNING nova.compute.manager [req-7516f21a-64db-4076-8287-50fc926b5883 req-7c1eb1fb-9b88-4062-9e35-81e82e41cafd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state building and task_state spawning.
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-deleted-d87ef898-e971-4f53-9983-08d9f93a9e84 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:28 user nova-compute[72405]: INFO nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Neutron deleted interface d87ef898-e971-4f53-9983-08d9f93a9e84; detaching it from the instance and deleting it from the info cache
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.neutron [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "address": "fa:16:3e:a3:4c:5b", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f79854-a8", "ovs_interfaceid": "d8f79854-a86d-4032-bc96-002ec5ef3dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Detach interface failed, port_id=d87ef898-e971-4f53-9983-08d9f93a9e84, reason: Instance c072a4fb-12b6-41dd-ae55-fefa191c46c1 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-deleted-d8f79854-a86d-4032-bc96-002ec5ef3dfe {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:28 user nova-compute[72405]: INFO nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Neutron deleted interface d8f79854-a86d-4032-bc96-002ec5ef3dfe; detaching it from the instance and deleting it from the info cache
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.neutron [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "address": "fa:16:3e:5f:6f:77", "network": {"id": "fac1aea2-050c-44fb-bcdd-3e084f5f66d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1194588132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf45ab-5e", "ovs_interfaceid": "bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Detach interface failed, port_id=d8f79854-a86d-4032-bc96-002ec5ef3dfe, reason: Instance c072a4fb-12b6-41dd-ae55-fefa191c46c1 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-deleted-bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:28 user nova-compute[72405]: INFO nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Neutron deleted interface bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6; detaching it from the instance and deleting it from the info cache
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.neutron [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [{"id": "9d662e25-ca05-4576-afb5-96314a853b4c", "address": "fa:16:3e:bb:90:ae", "network": {"id": "2bff0f31-62c6-4e8f-98c5-fda295f63eea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350534431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d662e25-ca", "ovs_interfaceid": "9d662e25-ca05-4576-afb5-96314a853b4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "address": "fa:16:3e:0f:ee:ef", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c07f90-37", "ovs_interfaceid": "b7c07f90-37b9-44a7-a5be-2dfcfb8c431b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15730843-12df-450c-a0ba-6b35564e526f", "address": "fa:16:3e:25:e0:28", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15730843-12", "ovs_interfaceid": "15730843-12df-450c-a0ba-6b35564e526f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "address": "fa:16:3e:66:04:ce", "network": {"id": "68788d50-afd3-4ddc-aff4-ef4c510ed77f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1799595925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3e83aa1a58c4be78275fb938dd39ac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8940fbb3-e6", "ovs_interfaceid": "8940fbb3-e675-4b99-abe3-e78516ccdd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-71e59a12-196c-43ce-934d-8c5e28e6bda6 req-ebc5f216-b99b-4ba4-81b2-216140254b9e service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Detach interface failed, port_id=bacf45ab-5ee7-4cbf-8161-fb0813b2ecd6, reason: Instance c072a4fb-12b6-41dd-ae55-fefa191c46c1 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.neutron [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:30:28 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance destroyed successfully.
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'resources' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG os_vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8654907e-98, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:28 user nova-compute[72405]: INFO os_vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98')
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start _get_guest_xml network_info=[{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'numa_topology' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:28 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:30:28 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:30:28 user nova-compute[72405]:   <uuid>80e7599c-bd2a-499d-9b2b-4c613f375900</uuid>
Aug 08 23:30:28 user nova-compute[72405]:   <name>instance-00000003</name>
Aug 08 23:30:28 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:30:28 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:30:28 user nova-compute[72405]:   <metadata>
Aug 08 23:30:28 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:30:28 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:30:28 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeTestJSON-server-1585614820</nova:name>
Aug 08 23:30:28 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:30:28</nova:creationTime>
Aug 08 23:30:28 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:30:28 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:30:28 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:30:28 user nova-compute[72405]:       <nova:owner>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:user uuid="e934b55e46634b7097bb144b74ac5954">tempest-AttachVolumeTestJSON-1838616528-project-member</nova:user>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:project uuid="72ebca86ade54e1f9805255b64901be8">tempest-AttachVolumeTestJSON-1838616528</nova:project>
Aug 08 23:30:28 user nova-compute[72405]:       </nova:owner>
Aug 08 23:30:28 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:30:28 user nova-compute[72405]:       <nova:ports>
Aug 08 23:30:28 user nova-compute[72405]:         <nova:port uuid="8654907e-9844-4cf4-8754-5b540b3aa53c">
Aug 08 23:30:28 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:30:28 user nova-compute[72405]:         </nova:port>
Aug 08 23:30:28 user nova-compute[72405]:       </nova:ports>
Aug 08 23:30:28 user nova-compute[72405]:     </nova:instance>
Aug 08 23:30:28 user nova-compute[72405]:   </metadata>
Aug 08 23:30:28 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:30:28 user nova-compute[72405]:     <system>
Aug 08 23:30:28 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:30:28 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:30:28 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:30:28 user nova-compute[72405]:       <entry name="serial">80e7599c-bd2a-499d-9b2b-4c613f375900</entry>
Aug 08 23:30:28 user nova-compute[72405]:       <entry name="uuid">80e7599c-bd2a-499d-9b2b-4c613f375900</entry>
Aug 08 23:30:28 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:30:28 user nova-compute[72405]:     </system>
Aug 08 23:30:28 user nova-compute[72405]:   </sysinfo>
Aug 08 23:30:28 user nova-compute[72405]:   <os>
Aug 08 23:30:28 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:30:28 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:30:28 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:30:28 user nova-compute[72405]:   </os>
Aug 08 23:30:28 user nova-compute[72405]:   <features>
Aug 08 23:30:28 user nova-compute[72405]:     <acpi/>
Aug 08 23:30:28 user nova-compute[72405]:     <apic/>
Aug 08 23:30:28 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:30:28 user nova-compute[72405]:   </features>
Aug 08 23:30:28 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:30:28 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:30:28 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:30:28 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:30:28 user nova-compute[72405]:   </clock>
Aug 08 23:30:28 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:30:28 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:30:28 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:30:28 user nova-compute[72405]:   </cpu>
Aug 08 23:30:28 user nova-compute[72405]:   <devices>
Aug 08 23:30:28 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:30:28 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:30:28 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk"/>
Aug 08 23:30:28 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:30:28 user nova-compute[72405]:     </disk>
Aug 08 23:30:28 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:30:28 user nova-compute[72405]:       <mac address="fa:16:3e:f6:53:af"/>
Aug 08 23:30:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:30:28 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:30:28 user nova-compute[72405]:       <target dev="tap8654907e-98"/>
Aug 08 23:30:28 user nova-compute[72405]:     </interface>
Aug 08 23:30:28 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:30:28 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/console.log" append="off"/>
Aug 08 23:30:28 user nova-compute[72405]:     </serial>
Aug 08 23:30:28 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:30:28 user nova-compute[72405]:     <video>
Aug 08 23:30:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:30:28 user nova-compute[72405]:     </video>
Aug 08 23:30:28 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:30:28 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:30:28 user nova-compute[72405]:     </rng>
Aug 08 23:30:28 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:30:28 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:30:28 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:30:28 user nova-compute[72405]:     </memballoon>
Aug 08 23:30:28 user nova-compute[72405]:   </devices>
Aug 08 23:30:28 user nova-compute[72405]: </domain>
Aug 08 23:30:28 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.191s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:30:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Cannot resize image /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'migration_context' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG os_vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8654907e-98, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8654907e-98, col_values=(('external_ids', {'iface-id': '8654907e-9844-4cf4-8754-5b540b3aa53c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:53:af', 'vm-uuid': '80e7599c-bd2a-499d-9b2b-4c613f375900'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:29 user nova-compute[72405]: INFO os_vif [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98')
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537429.3352227, 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] VM Resumed (Lifecycle Event)
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance spawned successfully.
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537429.3410897, 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] VM Started (Lifecycle Event)
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Took 9.70 seconds to spawn the instance on the hypervisor.
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-5b3375e8-f074-4762-b4ac-1fcdb0cd33f5 req-65908e2c-90f0-4fff-87f7-e2222ca73a0a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5b3375e8-f074-4762-b4ac-1fcdb0cd33f5 req-65908e2c-90f0-4fff-87f7-e2222ca73a0a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5b3375e8-f074-4762-b4ac-1fcdb0cd33f5 req-65908e2c-90f0-4fff-87f7-e2222ca73a0a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5b3375e8-f074-4762-b4ac-1fcdb0cd33f5 req-65908e2c-90f0-4fff-87f7-e2222ca73a0a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-5b3375e8-f074-4762-b4ac-1fcdb0cd33f5 req-65908e2c-90f0-4fff-87f7-e2222ca73a0a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:29 user nova-compute[72405]: WARNING nova.compute.manager [req-5b3375e8-f074-4762-b4ac-1fcdb0cd33f5 req-65908e2c-90f0-4fff-87f7-e2222ca73a0a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state building and task_state spawning.
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Took 10.72 seconds to build instance.
Aug 08 23:30:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1abbdc6c-54ae-423d-b849-b6584fa1cffb tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.819s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:29 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:29 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Took 7.51 seconds to deallocate network for instance.
Aug 08 23:30:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-cdd1a644-dc4a-44ba-90fb-e5d41c0e76e0 req-39433847-509c-4a94-8e19-69a0104e0853 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-deleted-9d662e25-ca05-4576-afb5-96314a853b4c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-cdd1a644-dc4a-44ba-90fb-e5d41c0e76e0 req-39433847-509c-4a94-8e19-69a0104e0853 service nova] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Received event network-vif-deleted-8940fbb3-e675-4b99-abe3-e78516ccdd08 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:31 user nova-compute[72405]: WARNING nova.compute.manager [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state stopped and task_state powering-on.
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:30:31 user nova-compute[72405]: WARNING nova.compute.manager [req-a63f573d-9e77-4f00-bc52-f91607398bfc req-5bcaeeaf-6cfb-46c6-b140-b4102b970802 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state stopped and task_state powering-on.
Aug 08 23:30:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [{"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-80e7599c-bd2a-499d-9b2b-4c613f375900" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:32 user nova-compute[72405]: INFO nova.compute.manager [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Took 2.78 seconds to detach 3 volumes for instance.
Aug 08 23:30:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537432.976921, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:30:32 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Resumed (Lifecycle Event)
Aug 08 23:30:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:30:32 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:30:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance rebooted successfully.
Aug 08 23:30:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-52ac6fbe-1146-4515-9077-4b301b7758df tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:30:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 08 23:30:33 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537432.9772935, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:30:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Started (Lifecycle Event)
Aug 08 23:30:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:33 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Deleted allocations for instance c072a4fb-12b6-41dd-ae55-fefa191c46c1
Aug 08 23:30:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e6aa38b-2479-498e-8297-a8f023521c59 tempest-TaggedBootDevicesTest_v242-1744341241 tempest-TaggedBootDevicesTest_v242-1744341241-project-member] Lock "c072a4fb-12b6-41dd-ae55-fefa191c46c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.265s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537420.8553684, c072a4fb-12b6-41dd-ae55-fefa191c46c1 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:30:35 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] VM Stopped (Lifecycle Event)
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-50f12a8b-e16b-4109-89fc-603345ebd6c2 None None] [instance: c072a4fb-12b6-41dd-ae55-fefa191c46c1] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:30:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:30:38 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:30:38 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.402114868164062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance cc8aece0-15d7-4e9d-994a-3a2592246f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 466645d2-64fb-4c97-899a-1997a0ef4bca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:30:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:30:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:30:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:30:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:30:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:30:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:30:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:30:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:31:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:31:14 user nova-compute[72405]: INFO nova.compute.claims [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Claim successful on node user
Aug 08 23:31:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:31:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.policy [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9b5279220af4cc4a364014419168ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf26de781ef4462914d7f32168b3192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:31:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Creating image(s)
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "/opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk 1073741824" returned: 0 in 0.057s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Successfully created port: e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Cannot resize image /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'migration_context' on Instance uuid baea144d-e0b9-484e-8898-1c2129ebb66e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Ensure instance console log exists: /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Successfully updated port: e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-changed-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Refreshing instance network info cache due to event network-changed-e7ecea70-ce83-4968-a3da-67c4362eda51. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] Acquiring lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updating instance_info_cache with network_info: [{"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Instance network_info: |[{"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] Acquired lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Refreshing network info cache for port e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Start _get_guest_xml network_info=[{"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:31:16 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:31:16 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1132311519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1132311519',id=25,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-m0wahmxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:31:15Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=baea144d-e0b9-484e-8898-1c2129ebb66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:31:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'pci_devices' on Instance uuid baea144d-e0b9-484e-8898-1c2129ebb66e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:31:17 user nova-compute[72405]:   <uuid>baea144d-e0b9-484e-8898-1c2129ebb66e</uuid>
Aug 08 23:31:17 user nova-compute[72405]:   <name>instance-00000019</name>
Aug 08 23:31:17 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:31:17 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:31:17 user nova-compute[72405]:   <metadata>
Aug 08 23:31:17 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:31:17 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:31:17 user nova-compute[72405]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1132311519</nova:name>
Aug 08 23:31:17 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:31:16</nova:creationTime>
Aug 08 23:31:17 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:31:17 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:31:17 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:31:17 user nova-compute[72405]:       <nova:owner>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:user uuid="d9b5279220af4cc4a364014419168ae8">tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member</nova:user>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:project uuid="1bf26de781ef4462914d7f32168b3192">tempest-ServerBootFromVolumeStableRescueTest-1549652719</nova:project>
Aug 08 23:31:17 user nova-compute[72405]:       </nova:owner>
Aug 08 23:31:17 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:31:17 user nova-compute[72405]:       <nova:ports>
Aug 08 23:31:17 user nova-compute[72405]:         <nova:port uuid="e7ecea70-ce83-4968-a3da-67c4362eda51">
Aug 08 23:31:17 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 08 23:31:17 user nova-compute[72405]:         </nova:port>
Aug 08 23:31:17 user nova-compute[72405]:       </nova:ports>
Aug 08 23:31:17 user nova-compute[72405]:     </nova:instance>
Aug 08 23:31:17 user nova-compute[72405]:   </metadata>
Aug 08 23:31:17 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:31:17 user nova-compute[72405]:     <system>
Aug 08 23:31:17 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:31:17 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:31:17 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:31:17 user nova-compute[72405]:       <entry name="serial">baea144d-e0b9-484e-8898-1c2129ebb66e</entry>
Aug 08 23:31:17 user nova-compute[72405]:       <entry name="uuid">baea144d-e0b9-484e-8898-1c2129ebb66e</entry>
Aug 08 23:31:17 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:31:17 user nova-compute[72405]:     </system>
Aug 08 23:31:17 user nova-compute[72405]:   </sysinfo>
Aug 08 23:31:17 user nova-compute[72405]:   <os>
Aug 08 23:31:17 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:31:17 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:31:17 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:31:17 user nova-compute[72405]:   </os>
Aug 08 23:31:17 user nova-compute[72405]:   <features>
Aug 08 23:31:17 user nova-compute[72405]:     <acpi/>
Aug 08 23:31:17 user nova-compute[72405]:     <apic/>
Aug 08 23:31:17 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:31:17 user nova-compute[72405]:   </features>
Aug 08 23:31:17 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:31:17 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:31:17 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:31:17 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:31:17 user nova-compute[72405]:   </clock>
Aug 08 23:31:17 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:31:17 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:31:17 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:31:17 user nova-compute[72405]:   </cpu>
Aug 08 23:31:17 user nova-compute[72405]:   <devices>
Aug 08 23:31:17 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:31:17 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:31:17 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk"/>
Aug 08 23:31:17 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:31:17 user nova-compute[72405]:     </disk>
Aug 08 23:31:17 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:31:17 user nova-compute[72405]:       <mac address="fa:16:3e:f0:ec:1b"/>
Aug 08 23:31:17 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:31:17 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:31:17 user nova-compute[72405]:       <target dev="tape7ecea70-ce"/>
Aug 08 23:31:17 user nova-compute[72405]:     </interface>
Aug 08 23:31:17 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:31:17 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/console.log" append="off"/>
Aug 08 23:31:17 user nova-compute[72405]:     </serial>
Aug 08 23:31:17 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:31:17 user nova-compute[72405]:     <video>
Aug 08 23:31:17 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:31:17 user nova-compute[72405]:     </video>
Aug 08 23:31:17 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:31:17 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:31:17 user nova-compute[72405]:     </rng>
Aug 08 23:31:17 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:31:17 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:31:17 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:31:17 user nova-compute[72405]:     </memballoon>
Aug 08 23:31:17 user nova-compute[72405]:   </devices>
Aug 08 23:31:17 user nova-compute[72405]: </domain>
Aug 08 23:31:17 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1132311519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1132311519',id=25,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-m0wahmxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:31:15Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=baea144d-e0b9-484e-8898-1c2129ebb66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG os_vif [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7ecea70-ce, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7ecea70-ce, col_values=(('external_ids', {'iface-id': 'e7ecea70-ce83-4968-a3da-67c4362eda51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:ec:1b', 'vm-uuid': 'baea144d-e0b9-484e-8898-1c2129ebb66e'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:17 user nova-compute[72405]: INFO os_vif [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce')
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No VIF found with MAC fa:16:3e:f0:ec:1b, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updated VIF entry in instance network info cache for port e7ecea70-ce83-4968-a3da-67c4362eda51. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updating instance_info_cache with network_info: [{"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f3569ef-ca63-4774-9ff6-75d43fbdaf21 req-56cd4cd6-1be7-443d-9772-3d03a431e90e service nova] Releasing lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-ea665115-63a3-410a-9c12-2912c4b67ba1 req-ae7ea576-b5f6-4799-9b22-306aaf8c3bdc service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ea665115-63a3-410a-9c12-2912c4b67ba1 req-ae7ea576-b5f6-4799-9b22-306aaf8c3bdc service nova] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ea665115-63a3-410a-9c12-2912c4b67ba1 req-ae7ea576-b5f6-4799-9b22-306aaf8c3bdc service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ea665115-63a3-410a-9c12-2912c4b67ba1 req-ae7ea576-b5f6-4799-9b22-306aaf8c3bdc service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-ea665115-63a3-410a-9c12-2912c4b67ba1 req-ae7ea576-b5f6-4799-9b22-306aaf8c3bdc service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] No waiting events found dispatching network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:31:18 user nova-compute[72405]: WARNING nova.compute.manager [req-ea665115-63a3-410a-9c12-2912c4b67ba1 req-ae7ea576-b5f6-4799-9b22-306aaf8c3bdc service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received unexpected event network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 for instance with vm_state building and task_state spawning.
Aug 08 23:31:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537480.7496555, baea144d-e0b9-484e-8898-1c2129ebb66e => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] VM Resumed (Lifecycle Event)
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Instance spawned successfully.
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537480.7551813, baea144d-e0b9-484e-8898-1c2129ebb66e => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] VM Started (Lifecycle Event)
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-3df38341-b52d-4b56-8e7a-48a0a6ce7420 req-d8469373-36da-4b2e-bf86-3a9eb480f11a service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3df38341-b52d-4b56-8e7a-48a0a6ce7420 req-d8469373-36da-4b2e-bf86-3a9eb480f11a service nova] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3df38341-b52d-4b56-8e7a-48a0a6ce7420 req-d8469373-36da-4b2e-bf86-3a9eb480f11a service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3df38341-b52d-4b56-8e7a-48a0a6ce7420 req-d8469373-36da-4b2e-bf86-3a9eb480f11a service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-3df38341-b52d-4b56-8e7a-48a0a6ce7420 req-d8469373-36da-4b2e-bf86-3a9eb480f11a service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] No waiting events found dispatching network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:31:20 user nova-compute[72405]: WARNING nova.compute.manager [req-3df38341-b52d-4b56-8e7a-48a0a6ce7420 req-d8469373-36da-4b2e-bf86-3a9eb480f11a service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received unexpected event network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 for instance with vm_state building and task_state spawning.
Aug 08 23:31:20 user nova-compute[72405]: INFO nova.compute.manager [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Took 6.91 seconds to build instance.
Aug 08 23:31:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4c45351-74de-499d-ba37-97e15b498c9f tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-changed-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:31:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Refreshing instance network info cache due to event network-changed-f7593a45-a32e-4150-ae32-f85caf5643c4. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:31:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] Acquiring lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] Acquired lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Refreshing network info cache for port f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:31:25 user nova-compute[72405]: DEBUG nova.network.neutron [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Updated VIF entry in instance network info cache for port f7593a45-a32e-4150-ae32-f85caf5643c4. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:31:25 user nova-compute[72405]: DEBUG nova.network.neutron [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Updating instance_info_cache with network_info: [{"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b6fbf71-d958-4d76-bb30-f5d17c695077 req-309b61fd-2ab0-4f0e-9aa9-5290a667a0b6 service nova] Releasing lock "refresh_cache-cc8aece0-15d7-4e9d-994a-3a2592246f8a" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:28 user nova-compute[72405]: INFO nova.compute.manager [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Attaching volume 03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad to /dev/vdb
Aug 08 23:31:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG os_brick.utils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a64ea-77c1-4df7-b1ec-adf18b94396c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a602613-18c4-49b3-9c70-727eedd46b8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[98791a61-26e5-4491-804e-afd34e372cf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21faf3c2-e8e7-41f2-9f2f-7e5e80131f88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:29 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:31:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5e441a-ec9a-4d10-9d4f-e7f1aceb96b4]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG os_brick.utils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:29 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Updating existing volume attachment record: 122e798b-49ad-4dbd-84f3-15b8aa4ca6e2 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:31:30 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:31:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'flavor' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:31 user nova-compute[72405]: INFO nova.compute.manager [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Attaching volume c092ae02-9d27-42ef-b4c5-f0953aa54ead to /dev/vdb
Aug 08 23:31:31 user nova-compute[72405]: DEBUG os_brick.utils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[543becd5-90c6-4ef5-be83-cd1918b9fc7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e0f450-00cd-4731-bdc2-7d9567f24b44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8824dab6-29f6-491e-bcdd-65c78855931f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731904e-932b-47dd-a2d8-449b43f4165c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:31 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[43641edb-c29b-455e-a2fd-3b5406911f23]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG os_brick.utils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating existing volume attachment record: ce7ffa2f-f1fe-4774-a3fd-b2a208aecede {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:31:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:31:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:34 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-changed-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:31:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Refreshing instance network info cache due to event network-changed-3f28230e-aa3c-4173-8904-fa38542e2554. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:31:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] Acquiring lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] Acquired lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Refreshing network info cache for port 3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'flavor' on Instance uuid 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Ignoring supplied device name: /dev/vdb
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:36 user nova-compute[72405]: INFO nova.compute.manager [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Attaching volume fc09a945-e122-4faa-a526-698e4622393f to /dev/vdb
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG nova.network.neutron [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updated VIF entry in instance network info cache for port 3f28230e-aa3c-4173-8904-fa38542e2554. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG nova.network.neutron [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updating instance_info_cache with network_info: [{"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5f66938b-0c5c-4aa7-9030-09ce20d4857f req-25360832-f36b-493e-b003-6bda32ed41d8 service nova] Releasing lock "refresh_cache-466645d2-64fb-4c97-899a-1997a0ef4bca" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG os_brick.utils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20fa8b1-eb7a-474c-91ab-3279e20e7e83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82df6f0-e1c0-4966-818a-fb59e3e31b32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b084e2f-28bc-4d6d-b313-6b190e35f535]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d11710-8feb-461a-9adc-4b7d0d38598a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:36 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21c75fe-b541-487a-a325-5838f5ab8ea3]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG os_brick.utils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== get_connector_properties: return (200ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updating existing volume attachment record: 5e24af5d-0cea-4f21-87eb-a21bd2de67d3 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:39 user nova-compute[72405]: INFO nova.compute.manager [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Unshelving
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:39 user nova-compute[72405]: INFO nova.virt.block_device [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Booting with volume bf353614-3578-4b1c-a636-15a160b4a834 at /dev/vda
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:40 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:31:40 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.334930419921875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance cc8aece0-15d7-4e9d-994a-3a2592246f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 466645d2-64fb-4c97-899a-1997a0ef4bca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 30ae278e-aa85-4896-84a1-a5301f5c5ccd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:31:40 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:31:41 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:31:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMpqCrNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:45 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:45 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:45 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd581ae6-fafc-4215-b6cd-fe495ac4ed07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:31:45 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f1481-1f65-43e3-b670-5f9c7c0602c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f] added
Aug 08 23:31:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[048dcc6e-824d-46c8-923b-405dbd55d70a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73770a2-48db-4f06-984d-3846a874f22c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMpqCrNR {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMpqCrNR" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b22cea6-b4e7-4111-8a4c-ca37154b520c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMpqCrNR'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'flavor' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1711c7c0-d669-4411-badc-ae7263ff2de1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d694f116-494b-4681-b067-2588cb4f4f0e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71354390-a332-42a8-829d-ffb394bd5511]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260]
Aug 08 23:31:45 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260] successful.
Aug 08 23:31:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4c26f0-70ca-476d-b927-59f40d5bb7ec]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bbbdda-fbda-4eff-8465-a251db915489]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:45 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:45 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b38ef8-0ccf-4953-a49d-031ef2cc2f3e]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:31:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMpqCrNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.utils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff569da-997d-40d7-a723-02b6e9503a6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d14e0-6457-41cf-a229-bbd1e496ac1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[af050910-a75e-4cf7-b602-ca235ac404fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf843b-a454-4c22-8274-130eff72dbdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:46 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[54319d8e-01d1-4ecb-bd05-fd7ba38073b5]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.utils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating existing volume attachment record: e40f747c-6557-4f3a-aee7-8636078c3aa7 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:46 user nova-compute[72405]: INFO nova.compute.manager [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Attaching volume 962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 to /dev/vdb
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23465396439613330', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465396439613330', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'flavor' on Instance uuid 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:31:46 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:31:46 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:31:46 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:31:46 user nova-compute[72405]:   <serial>fc09a945-e122-4faa-a526-698e4622393f</serial>
Aug 08 23:31:46 user nova-compute[72405]: </disk>
Aug 08 23:31:46 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:31:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:31:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:31:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No VIF found with MAC fa:16:3e:e5:34:56, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:31:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hsfjctXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:52 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9cff3d-7fc2-4aa1-9a25-66cc7898f042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:31:52 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbca71b-2766-4c53-8660-b58179da1a6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad] added
Aug 08 23:31:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f0975-4f83-4900-8793-83ccd6a35368]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f419aa-83f9-4b30-8a8c-d80071a5ea7f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hsfjctXD {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hsfjctXD" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca6d0a-8e1d-468d-966d-333ae0789a9f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hsfjctXD'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d945d-60a4-47fd-8a28-2325bea87746]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee652e20-2839-44c8-99e0-6689fc886777]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:52 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:52 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71a843c-7893-4eee-a092-1351e0980a5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260]
Aug 08 23:31:52 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260] successful.
Aug 08 23:31:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3586ac16-3321-4463-acbf-98a913c44b09]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be4198-0e22-49c8-b343-74bebaec31a3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:52 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:52 user nova-compute[72405]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad (non-flash)
Aug 08 23:31:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:52 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:52 user nova-compute[72405]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad (non-flash)
Aug 08 23:31:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9ff1ed86-d72e-41db-a40b-625a3f904b0d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.412s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae841e5-0b4f-4039-bd0c-d5185515cfff]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hsfjctXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG os_brick.utils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac482d2-3d4b-44a3-87db-786cd0ff43c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8765381b-e457-4bdf-bd0b-04edbeba8f1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846b3e9-65ab-45d2-afbb-cc76cc06fd84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bcca8e-1a9c-4e0e-8f22-a813089c8ffa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:31:53 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:31:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe5e4a-706a-456d-a3dc-cc18b29f5f89]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.utils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating existing volume attachment record: 5332a577-f45f-4dc0-96ff-235032ec5212 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23834326664336431', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834326664336431', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:31:53 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:31:53 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:31:53 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:31:53 user nova-compute[72405]:   <serial>03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad</serial>
Aug 08 23:31:53 user nova-compute[72405]: </disk>
Aug 08 23:31:53 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:31:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:31:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:31:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:24:43:e2, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:31:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ee2610a3-0a17-46b1-b93c-5477236075a3 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.023s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'pci_requests' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'numa_topology' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:31:55 user nova-compute[72405]: INFO nova.compute.claims [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Claim successful on node user
Aug 08 23:31:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:56 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:31:56 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:31:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:56 user nova-compute[72405]: INFO nova.network.neutron [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating port 1bc5f924-bce3-4575-b361-f65e36f62b88 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:57 user nova-compute[72405]: INFO nova.compute.manager [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Detaching volume 03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad
Aug 08 23:31:57 user nova-compute[72405]: INFO nova.virt.block_device [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Attempting to driver detach volume 03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad from mountpoint /dev/vdb
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Attempting to detach device vdb from instance cc8aece0-15d7-4e9d-994a-3a2592246f8a from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:31:57 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:31:57 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:31:57 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:31:57 user nova-compute[72405]:   <serial>03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad</serial>
Aug 08 23:31:57 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:31:57 user nova-compute[72405]: </disk>
Aug 08 23:31:57 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:31:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully detached device vdb from instance cc8aece0-15d7-4e9d-994a-3a2592246f8a from the persistent domain config.
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc8aece0-15d7-4e9d-994a-3a2592246f8a from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:31:57 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:31:57 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:31:57 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:31:57 user nova-compute[72405]:   <serial>03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad</serial>
Aug 08 23:31:57 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:31:57 user nova-compute[72405]: </disk>
Aug 08 23:31:57 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing instance network info cache due to event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:31:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537518.104005, cc8aece0-15d7-4e9d-994a-3a2592246f8a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:31:58 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully detached device vdb from instance cc8aece0-15d7-4e9d-994a-3a2592246f8a from the live domain config.
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hsfjctXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:58 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[83260832-7dfa-4be6-b313-c5416af59a97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78fc19-9f2d-41a8-bd3f-56471cef7fac]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad (non-flash)
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad (non-flash)
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9815de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2326af-10c9-45af-8bda-8794eb55bd7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[580accfd-77c1-42e9-9285-0883313617d3]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[79554948-93f0-4fb8-a039-ab1de5db0a03]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.network.neutron [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:31:58 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Creating image(s)
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Ensure instance console log exists: /opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Start _get_guest_xml network_info=[{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e40f747c-6557-4f3a-aee7-8636078c3aa7', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30ae278e-aa85-4896-84a1-a5301f5c5ccd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf353614-3578-4b1c-a636-15a160b4a834', 'serial': 'bf353614-3578-4b1c-a636-15a160b4a834'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1abb76-b126-43bf-8cb3-b6c0bcaa4aa1]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:31:58 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99a457-c68e-4338-91aa-5159cb461110]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:58 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0edc9-5b61-49c7-9fad-6e4b587772e3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260]
Aug 08 23:31:58 user nova-compute[72405]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad, portal: 172.16.0.220,3260] successful.
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03e5b7d3-c0e3-46e9-a4fd-0fbfc835cbad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1904b9-7089-4f19-a197-f4f3cd679529]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== disconnect_volume: return (379ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.063s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:58 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:58 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b564f12-4edb-4fd7-94c4-c3a35153e485]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:31:58 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b0ae84-4324-462f-b166-2b72b9c24edd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834] added
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a08f2-5a06-432a-af73-9e1010ff050a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4150a31-ccaf-4e6a-8c27-a7d935321207]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzcsBhyu {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzcsBhyu" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f9cf93-7ab0-4ef7-a75b-f4aaeadd6208]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NzcsBhyu'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6074d5-d4a2-4815-83da-fb80368ea349]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be73fdd-b561-49d2-8c76-1c33c3c2559b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6dbfaf-3a04-401e-abfb-61894096b5fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]
Aug 08 23:31:58 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e69474b-010b-41d2-b8ca-60663555acbb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc42cc-b13e-44cd-afd6-3e9e61790383]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:31:58 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:31:58 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7693f-ea30-43cb-a2be-ad9ac9b963e8]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:58 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updated VIF entry in instance network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d676b30c-af19-4dd2-a0d5-3799bc00d1ea req-4b88c69e-652f-4d47-9100-fee4362ba643 service nova] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:31:59 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3b3b06a5-56f0-46df-99d3-b8175345981b tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.960s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23634393238373231', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634393238373231', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.463s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:59 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:31:59 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1879559594',display_name='tempest-TestShelveInstance-server-1879559594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1879559594',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-350639281',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3d232f86412044a58663caf23a71cc3b',ramdisk_id='',reservation_id='r-wt4dngfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1642333906',owner_user_name='tempest-TestShelveInstance-1642333906-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:31:39Z,user_data=None,user_id='3e3c4d0e349b49f0ac2151b1bcb1af87',uuid=30ae278e-aa85-4896-84a1-a5301f5c5ccd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converting VIF {"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.objects.instance [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ed15fb-93dc-4521-886c-6937312ce4c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:31:59 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:31:59 user nova-compute[72405]:   <uuid>30ae278e-aa85-4896-84a1-a5301f5c5ccd</uuid>
Aug 08 23:31:59 user nova-compute[72405]:   <name>instance-00000013</name>
Aug 08 23:31:59 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:31:59 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:31:59 user nova-compute[72405]:   <metadata>
Aug 08 23:31:59 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:31:59 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:31:59 user nova-compute[72405]:       <nova:name>tempest-TestShelveInstance-server-1879559594</nova:name>
Aug 08 23:31:59 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:31:58</nova:creationTime>
Aug 08 23:31:59 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:31:59 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:31:59 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:31:59 user nova-compute[72405]:       <nova:owner>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:user uuid="3e3c4d0e349b49f0ac2151b1bcb1af87">tempest-TestShelveInstance-1642333906-project-member</nova:user>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:project uuid="3d232f86412044a58663caf23a71cc3b">tempest-TestShelveInstance-1642333906</nova:project>
Aug 08 23:31:59 user nova-compute[72405]:       </nova:owner>
Aug 08 23:31:59 user nova-compute[72405]:       <nova:ports>
Aug 08 23:31:59 user nova-compute[72405]:         <nova:port uuid="1bc5f924-bce3-4575-b361-f65e36f62b88">
Aug 08 23:31:59 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 08 23:31:59 user nova-compute[72405]:         </nova:port>
Aug 08 23:31:59 user nova-compute[72405]:       </nova:ports>
Aug 08 23:31:59 user nova-compute[72405]:     </nova:instance>
Aug 08 23:31:59 user nova-compute[72405]:   </metadata>
Aug 08 23:31:59 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:31:59 user nova-compute[72405]:     <system>
Aug 08 23:31:59 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:31:59 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:31:59 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:31:59 user nova-compute[72405]:       <entry name="serial">30ae278e-aa85-4896-84a1-a5301f5c5ccd</entry>
Aug 08 23:31:59 user nova-compute[72405]:       <entry name="uuid">30ae278e-aa85-4896-84a1-a5301f5c5ccd</entry>
Aug 08 23:31:59 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:31:59 user nova-compute[72405]:     </system>
Aug 08 23:31:59 user nova-compute[72405]:   </sysinfo>
Aug 08 23:31:59 user nova-compute[72405]:   <os>
Aug 08 23:31:59 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:31:59 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:31:59 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:31:59 user nova-compute[72405]:   </os>
Aug 08 23:31:59 user nova-compute[72405]:   <features>
Aug 08 23:31:59 user nova-compute[72405]:     <acpi/>
Aug 08 23:31:59 user nova-compute[72405]:     <apic/>
Aug 08 23:31:59 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:31:59 user nova-compute[72405]:   </features>
Aug 08 23:31:59 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:31:59 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:31:59 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:31:59 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:31:59 user nova-compute[72405]:   </clock>
Aug 08 23:31:59 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:31:59 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:31:59 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:31:59 user nova-compute[72405]:   </cpu>
Aug 08 23:31:59 user nova-compute[72405]:   <devices>
Aug 08 23:31:59 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:31:59 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:31:59 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:31:59 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:31:59 user nova-compute[72405]:       <serial>bf353614-3578-4b1c-a636-15a160b4a834</serial>
Aug 08 23:31:59 user nova-compute[72405]:     </disk>
Aug 08 23:31:59 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:31:59 user nova-compute[72405]:       <mac address="fa:16:3e:7d:1c:56"/>
Aug 08 23:31:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:31:59 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:31:59 user nova-compute[72405]:       <target dev="tap1bc5f924-bc"/>
Aug 08 23:31:59 user nova-compute[72405]:     </interface>
Aug 08 23:31:59 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:31:59 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd/console.log" append="off"/>
Aug 08 23:31:59 user nova-compute[72405]:     </serial>
Aug 08 23:31:59 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:31:59 user nova-compute[72405]:     <video>
Aug 08 23:31:59 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:31:59 user nova-compute[72405]:     </video>
Aug 08 23:31:59 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:31:59 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:31:59 user nova-compute[72405]:     </rng>
Aug 08 23:31:59 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:31:59 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:31:59 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:31:59 user nova-compute[72405]:     </memballoon>
Aug 08 23:31:59 user nova-compute[72405]:   </devices>
Aug 08 23:31:59 user nova-compute[72405]: </domain>
Aug 08 23:31:59 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1879559594',display_name='tempest-TestShelveInstance-server-1879559594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1879559594',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-350639281',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3d232f86412044a58663caf23a71cc3b',ramdisk_id='',reservation_id='r-wt4dngfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1642333906',owner_user_name='tempest-TestShelveInstance-1642333906-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:31:39Z,user_data=None,user_id='3e3c4d0e349b49f0ac2151b1bcb1af87',uuid=30ae278e-aa85-4896-84a1-a5301f5c5ccd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converting VIF {"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_vif [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bc5f924-bc, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bc5f924-bc, col_values=(('external_ids', {'iface-id': '1bc5f924-bce3-4575-b361-f65e36f62b88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:1c:56', 'vm-uuid': '30ae278e-aa85-4896-84a1-a5301f5c5ccd'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b36262-afcb-4a8c-88f8-d32608adbe06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead] added
Aug 08 23:31:59 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:31:59 user nova-compute[72405]: INFO os_vif [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc')
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08385b-4c14-4c8a-a792-9c8ba7a715e9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:31:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedb79da-aa0b-4559-b1dd-a5d80c65c947]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQAdeXBW {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] No VIF found with MAC fa:16:3e:7d:1c:56, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQAdeXBW" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de3ec7e-6265-49a7-a5e7-084cae754620]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQAdeXBW'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a212152f-b994-4582-9c4c-a98198f08147]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[073a312a-21e9-49f9-b9e8-ffa16258665e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[356357d7-478c-4f45-b8d9-936aabf3a637]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]
Aug 08 23:32:00 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9180d5-08d1-4550-bb7d-984d2786f53e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7be71-a301-4ac3-b3cb-02e23a27bc92]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:00 user nova-compute[72405]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.121s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccde394f-d919-41de-a2cd-e64c82bb41a2]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== connect_volume: return (1962ms) {'type': 'block', 'scsi_wwn': '26439356237323937', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439356237323937', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'flavor' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:32:01 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:01 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:32:01 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:32:01 user nova-compute[72405]:   <serial>c092ae02-9d27-42ef-b4c5-f0953aa54ead</serial>
Aug 08 23:32:01 user nova-compute[72405]: </disk>
Aug 08 23:32:01 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-60a82578-e226-49a4-a6b2-7f4ea65e93e4 req-3ff70e23-ca74-496c-9e62-1a4b9d1944b3 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-60a82578-e226-49a4-a6b2-7f4ea65e93e4 req-3ff70e23-ca74-496c-9e62-1a4b9d1944b3 service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-60a82578-e226-49a4-a6b2-7f4ea65e93e4 req-3ff70e23-ca74-496c-9e62-1a4b9d1944b3 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-60a82578-e226-49a4-a6b2-7f4ea65e93e4 req-3ff70e23-ca74-496c-9e62-1a4b9d1944b3 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-60a82578-e226-49a4-a6b2-7f4ea65e93e4 req-3ff70e23-ca74-496c-9e62-1a4b9d1944b3 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:01 user nova-compute[72405]: WARNING nova.compute.manager [req-60a82578-e226-49a4-a6b2-7f4ea65e93e4 req-3ff70e23-ca74-496c-9e62-1a4b9d1944b3 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 08 23:32:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No VIF found with MAC fa:16:3e:2f:cf:a3, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-18941ea3-15bb-4c53-8848-1a35d739a5d4 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.312s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-5e3cbe17-83c0-4076-b84d-92040cf2877a req-bf0a7298-0237-4ae4-8705-c3196752b629 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e3cbe17-83c0-4076-b84d-92040cf2877a req-bf0a7298-0237-4ae4-8705-c3196752b629 service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e3cbe17-83c0-4076-b84d-92040cf2877a req-bf0a7298-0237-4ae4-8705-c3196752b629 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e3cbe17-83c0-4076-b84d-92040cf2877a req-bf0a7298-0237-4ae4-8705-c3196752b629 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-5e3cbe17-83c0-4076-b84d-92040cf2877a req-bf0a7298-0237-4ae4-8705-c3196752b629 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:03 user nova-compute[72405]: WARNING nova.compute.manager [req-5e3cbe17-83c0-4076-b84d-92040cf2877a req-bf0a7298-0237-4ae4-8705-c3196752b629 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537524.4926898, 30ae278e-aa85-4896-84a1-a5301f5c5ccd => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:04 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] VM Resumed (Lifecycle Event)
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:32:04 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance spawned successfully.
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:04 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537524.4970794, 30ae278e-aa85-4896-84a1-a5301f5c5ccd => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:04 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] VM Started (Lifecycle Event)
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:04 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:32:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-63a5048d-093a-4140-ad1b-35da504ef571 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.473s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Stashing vm_state: active {{(pid=72405) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 08 23:32:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:32:05 user nova-compute[72405]: INFO nova.compute.claims [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Claim successful on node user
Aug 08 23:32:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'resources' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:05 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating resource usage from migration 6af202c9-a8e7-43bf-affd-7985a25456c1
Aug 08 23:32:06 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:06 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.580s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:06 user nova-compute[72405]: INFO nova.compute.manager [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Migrating
Aug 08 23:32:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:06 user nova-compute[72405]: INFO nova.compute.rpcapi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 08 23:32:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Starting migrate_disk_and_power_off {{(pid=72405) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-de7fac89-042a-4dff-a7fc-c8f73aa71e8b req-4c95aa1b-be54-4c95-b252-96f036d859e2 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de7fac89-042a-4dff-a7fc-c8f73aa71e8b req-4c95aa1b-be54-4c95-b252-96f036d859e2 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de7fac89-042a-4dff-a7fc-c8f73aa71e8b req-4c95aa1b-be54-4c95-b252-96f036d859e2 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de7fac89-042a-4dff-a7fc-c8f73aa71e8b req-4c95aa1b-be54-4c95-b252-96f036d859e2 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-de7fac89-042a-4dff-a7fc-c8f73aa71e8b req-4c95aa1b-be54-4c95-b252-96f036d859e2 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:08 user nova-compute[72405]: WARNING nova.compute.manager [req-de7fac89-042a-4dff-a7fc-c8f73aa71e8b req-4c95aa1b-be54-4c95-b252-96f036d859e2 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:32:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance destroyed successfully.
Aug 08 23:32:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f2e3cc-1e, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:08 user nova-compute[72405]: INFO os_vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e')
Aug 08 23:32:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:08 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c25686-8f40-46b4-947d-265e49c94082]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd02e55-2822-4ac4-a7f4-931d4299bce3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:08 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:08 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:08 user nova-compute[72405]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:08 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:08 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:08 user nova-compute[72405]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba5514310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e6056b-1e7b-4ef3-b774-3120263799f3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[043ee503-3008-4bb7-900b-f0ff1a6e4a49]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ccc386-3e0b-49a1-91e1-5d75acda92eb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3235994b-8770-4b14-a248-765e663b2ed9]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b038c7-c363-4dd4-9fc3-45dc97696eb5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[56442214-3e9f-43ad-8b02-4093e4d55da2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]
Aug 08 23:32:08 user nova-compute[72405]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4900ea72-b06c-4dd1-b9b5-0f8e5f7978dd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== disconnect_volume: return (361ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf_resize/disk /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "cp -r /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf_resize/disk /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk" returned: 0 in 0.419s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf_resize/disk.info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk.info {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "cp -r /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf_resize/disk.info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk.info" returned: 0 in 0.037s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-fe828d70-7ecf-4b62-a912-ff34bee9a979 req-068ef2d9-7eb9-4be9-bfda-58b7e96995ac service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fe828d70-7ecf-4b62-a912-ff34bee9a979 req-068ef2d9-7eb9-4be9-bfda-58b7e96995ac service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fe828d70-7ecf-4b62-a912-ff34bee9a979 req-068ef2d9-7eb9-4be9-bfda-58b7e96995ac service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fe828d70-7ecf-4b62-a912-ff34bee9a979 req-068ef2d9-7eb9-4be9-bfda-58b7e96995ac service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-fe828d70-7ecf-4b62-a912-ff34bee9a979 req-068ef2d9-7eb9-4be9-bfda-58b7e96995ac service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:10 user nova-compute[72405]: WARNING nova.compute.manager [req-fe828d70-7ecf-4b62-a912-ff34bee9a979 req-068ef2d9-7eb9-4be9-bfda-58b7e96995ac service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:32:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-changed-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing instance network info cache due to event network-changed-418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Port f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 binding to destination host user is already ACTIVE {{(pid=72405) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAJdNXFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:12 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:12 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:12 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae99be08-d8de-4f1f-bc02-3e6b450029cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:32:12 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2dddbc-cbd4-4789-b993-601b909cf025]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8] added
Aug 08 23:32:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5182ada-a20e-45b2-addd-1192267bfcf9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5498b9c1-a28b-4aa2-80d0-8fb6bd151de9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAJdNXFn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAJdNXFn" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb08c0b8-169d-43ff-968f-ef7c8ed4b88c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAJdNXFn'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a94b23-549e-4d85-9976-a12f661ce6db]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updated VIF entry in instance network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[49679b74-c2dd-49e4-b76d-fc40169a417c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4d4dffb1-ac03-4072-b7e7-87026e113f7d req-c988b5b6-4a79-4d5d-9274-bc2352863eca service nova] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df6e4a-760f-4624-bbbf-729a1c8a4ed9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260]
Aug 08 23:32:12 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ebe3f1-8433-4cf0-af6d-55b3aec7686d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa3983-1d4e-4fcb-a176-625e53c3f5a8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:12 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df8b2bb-3a8c-404d-b9f5-d8ff71db38e2]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAJdNXFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG os_brick.utils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbf8f5-de3c-4962-97c4-99bdcd3a26a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6461b2ab-8e4f-427c-8343-4491ae913dbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7fd0f1-64dd-461d-a63d-f43539b3b80d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f561347-f8c0-4d42-bd8e-960aaa72e5a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:32:13 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:32:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa983e-38e5-4f26-9bc2-57a82ecf9d86]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.utils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26335366132626162', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335366132626162', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'flavor' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:32:13 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:13 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:32:13 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:32:13 user nova-compute[72405]:   <serial>962aa7c4-12e6-44e8-a72c-074c3c3bf9f8</serial>
Aug 08 23:32:13 user nova-compute[72405]: </disk>
Aug 08 23:32:13 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No VIF found with MAC fa:16:3e:55:12:ff, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5cfed801-2b6a-4d57-b1bd-4dd1786f59c9 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.785s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:15 user nova-compute[72405]: INFO nova.compute.manager [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Rescuing
Aug 08 23:32:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'flavor' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:16 user nova-compute[72405]: INFO nova.compute.manager [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attaching volume 0f3fca48-1880-4f2c-9873-528ae41fdcc0 to /dev/vdb
Aug 08 23:32:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG os_brick.utils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da1ca4c-abbf-4773-b9d8-4b6c8cc83529]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b124f-8b57-4a15-9132-baa2ce96f55b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a6f7c2-c553-4850-8020-8563e333a37d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3001dfb-00cc-4604-9931-b9b10341ab5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:32:16 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:32:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d4e203-2fe5-4db2-b0c4-8c77fcd7028a]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG os_brick.utils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:16 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating existing volume attachment record: 38d914ce-9235-48df-96a6-e0a0dc00f653 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:32:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance destroyed successfully.
Aug 08 23:32:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Attempting a stable device rescue
Aug 08 23:32:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72405) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 08 23:32:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:32:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Creating image(s)
Aug 08 23:32:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:17 user nova-compute[72405]: DEBUG nova.objects.instance [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f5a3ccf3cf5922203f0a6e60cae557a375938f7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f5a3ccf3cf5922203f0a6e60cae557a375938f7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-1d84d374-2808-476d-a9fc-58a7307616d3 req-2b361d9b-8668-4532-8928-1930f5a0e65b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1d84d374-2808-476d-a9fc-58a7307616d3 req-2b361d9b-8668-4532-8928-1930f5a0e65b service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1d84d374-2808-476d-a9fc-58a7307616d3 req-2b361d9b-8668-4532-8928-1930f5a0e65b service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1d84d374-2808-476d-a9fc-58a7307616d3 req-2b361d9b-8668-4532-8928-1930f5a0e65b service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-1d84d374-2808-476d-a9fc-58a7307616d3 req-2b361d9b-8668-4532-8928-1930f5a0e65b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:18 user nova-compute[72405]: WARNING nova.compute.manager [req-1d84d374-2808-476d-a9fc-58a7307616d3 req-2b361d9b-8668-4532-8928-1930f5a0e65b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state active and task_state rescuing.
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:18 user nova-compute[72405]: INFO nova.compute.manager [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Shelving
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.part --force-share --output=json" returned: 0 in 0.209s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG nova.virt.images [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] cecf4f68-9fe3-4763-bbef-a6bcd8405208 was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.part /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.part /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.converted" returned: 0 in 0.443s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:19 user nova-compute[72405]: INFO nova.compute.manager [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Terminating instance
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-05ab2e9c-9438-4d5a-a42d-b6037e30a9de req-e4329bf8-c873-4a34-adfe-7c4f7decef89 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-05ab2e9c-9438-4d5a-a42d-b6037e30a9de req-e4329bf8-c873-4a34-adfe-7c4f7decef89 service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-05ab2e9c-9438-4d5a-a42d-b6037e30a9de req-e4329bf8-c873-4a34-adfe-7c4f7decef89 service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-05ab2e9c-9438-4d5a-a42d-b6037e30a9de req-e4329bf8-c873-4a34-adfe-7c4f7decef89 service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-05ab2e9c-9438-4d5a-a42d-b6037e30a9de req-e4329bf8-c873-4a34-adfe-7c4f7decef89 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:19 user nova-compute[72405]: WARNING nova.compute.manager [req-05ab2e9c-9438-4d5a-a42d-b6037e30a9de req-e4329bf8-c873-4a34-adfe-7c4f7decef89 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state active and task_state shelving.
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f5a3ccf3cf5922203f0a6e60cae557a375938f7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.140s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f5a3ccf3cf5922203f0a6e60cae557a375938f7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f5a3ccf3cf5922203f0a6e60cae557a375938f7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-c5f7635e-801b-4ae3-a299-a5a8480dc03b req-d6da826a-a65d-4a9e-a0f8-709fdb1ab2c5 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c5f7635e-801b-4ae3-a299-a5a8480dc03b req-d6da826a-a65d-4a9e-a0f8-709fdb1ab2c5 service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c5f7635e-801b-4ae3-a299-a5a8480dc03b req-d6da826a-a65d-4a9e-a0f8-709fdb1ab2c5 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c5f7635e-801b-4ae3-a299-a5a8480dc03b req-d6da826a-a65d-4a9e-a0f8-709fdb1ab2c5 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-c5f7635e-801b-4ae3-a299-a5a8480dc03b req-d6da826a-a65d-4a9e-a0f8-709fdb1ab2c5 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:19 user nova-compute[72405]: WARNING nova.compute.manager [req-c5f7635e-801b-4ae3-a299-a5a8480dc03b req-d6da826a-a65d-4a9e-a0f8-709fdb1ab2c5 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state active and task_state rescuing.
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a --force-share --output=json" returned: 0 in 0.194s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a,backing_fmt=raw /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a,backing_fmt=raw /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue" returned: 0 in 0.084s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f5a3ccf3cf5922203f0a6e60cae557a375938f7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'migration_context' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Start _get_guest_xml network_info=[{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "vif_mac": "fa:16:3e:55:12:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cecf4f68-9fe3-4763-bbef-a6bcd8405208', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5332a577-f45f-4dc0-96ff-235032ec5212', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAJdNXFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f7fccdf2-d173-42c4-9c04-421e7dfe6ef0', 'attached_at': '', 'detached_at': '', 'volume_id': '962aa7c4-12e6-44e8-a72c-074c3c3bf9f8', 'serial': '962aa7c4-12e6-44e8-a72c-074c3c3bf9f8'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'resources' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'numa_topology' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:19 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance destroyed successfully.
Aug 08 23:32:19 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:19 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAJdNXFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:19 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:19 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:19 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:32:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Beginning cold snapshot process
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260" returned: 0 in 0.049s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c321c50-9336-4abf-9405-82b6db4a9577]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kAJdNXFn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 08 23:32:20 user nova-compute[72405]: node.name = iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8
Aug 08 23:32:20 user nova-compute[72405]: node.tpgt = -1
Aug 08 23:32:20 user nova-compute[72405]: node.startup = automatic
Aug 08 23:32:20 user nova-compute[72405]: node.leading_login = No
Aug 08 23:32:20 user nova-compute[72405]: iface.iscsi_ifacename = default
Aug 08 23:32:20 user nova-compute[72405]: iface.net_ifacename = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.ipaddress = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.prefix_len = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.hwaddress = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.transport_name = tcp
Aug 08 23:32:20 user nova-compute[72405]: iface.initiatorname = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.vlan_id = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.vlan_priority = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.vlan_state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.iface_num = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.mtu = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.port = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.bootproto = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.subnet_mask = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.gateway = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_alt_client_id_state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_alt_client_id = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_dns = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_learn_iqn = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_req_vendor_id_state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_vendor_id_state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_vendor_id = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.dhcp_slp_da = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.fragmentation = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.gratuitous_arp = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.incoming_forwarding = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.tos_state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.tos = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.ttl = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.delayed_ack = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.tcp_nagle = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.tcp_wsf_state = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.tcp_wsf = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.tcp_timer_scale = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.tcp_timestamp = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.redirect = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.def_task_mgmt_timeout = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.header_digest = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.data_digest = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.immediate_data = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.initial_r2t = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.data_seq_inorder = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.data_pdu_inorder = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.erl = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.max_receive_data_len = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.first_burst_len = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.max_outstanding_r2t = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.max_burst_len = 0
Aug 08 23:32:20 user nova-compute[72405]: iface.chap_auth = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.bidi_chap = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.strict_login_compliance = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.discovery_auth = <empty>
Aug 08 23:32:20 user nova-compute[72405]: iface.discovery_logout = <empty>
Aug 08 23:32:20 user nova-compute[72405]: node.discovery_address = <empty>
Aug 08 23:32:20 user nova-compute[72405]: node.discovery_port = 0
Aug 08 23:32:20 user nova-compute[72405]: node.discovery_type = static
Aug 08 23:32:20 user nova-compute[72405]: node.session.initial_cmdsn = 0
Aug 08 23:32:20 user nova-compute[72405]: node.session.initial_login_retry_max = 8
Aug 08 23:32:20 user nova-compute[72405]: node.session.xmit_thread_priority = -20
Aug 08 23:32:20 user nova-compute[72405]: node.session.cmds_max = 128
Aug 08 23:32:20 user nova-compute[72405]: node.session.queue_depth = 32
Aug 08 23:32:20 user nova-compute[72405]: node.session.nr_sessions = 1
Aug 08 23:32:20 user nova-compute[72405]: node.session.auth.authmethod = CHAP
Aug 08 23:32:20 user nova-compute[72405]: node.session.auth.username = kAJdNXFn
Aug 08 23:32:20 user nova-compute[72405]: node.session.auth.password = ***
Aug 08 23:32:20 user nova-compute[72405]: node.session.auth.username_in = <empty>
Aug 08 23:32:20 user nova-compute[72405]: node.session.auth.password_in = <empty>
Aug 08 23:32:20 user nova-compute[72405]: node.session.auth.chap_algs = MD5
Aug 08 23:32:20 user nova-compute[72405]: node.session.timeo.replacement_timeout = 120
Aug 08 23:32:20 user nova-compute[72405]: node.session.err_timeo.abort_timeout = 15
Aug 08 23:32:20 user nova-compute[72405]: node.session.err_timeo.lu_reset_timeout = 30
Aug 08 23:32:20 user nova-compute[72405]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 08 23:32:20 user nova-compute[72405]: node.session.err_timeo.host_reset_timeout = 60
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.FastAbort = Yes
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.InitialR2T = No
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.ImmediateData = Yes
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.FirstBurstLength = 262144
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.MaxBurstLength = 16776192
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.DefaultTime2Retain = 0
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.DefaultTime2Wait = 2
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.MaxConnections = 1
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 08 23:32:20 user nova-compute[72405]: node.session.iscsi.ERL = 0
Aug 08 23:32:20 user nova-compute[72405]: node.session.scan = manual
Aug 08 23:32:20 user nova-compute[72405]: node.session.reopen_max = 0
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].address = 172.16.0.220
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].port = 3260
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].startup = manual
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].tcp.window_size = 524288
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].tcp.type_of_service = 0
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].timeo.logout_timeout = 15
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].timeo.login_timeout = 15
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].timeo.auth_timeout = 45
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].timeo.noop_out_interval = 5
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].timeo.noop_out_timeout = 5
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].iscsi.HeaderDigest = None
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].iscsi.DataDigest = None
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].iscsi.IFMarker = No
Aug 08 23:32:20 user nova-compute[72405]: node.conn[0].iscsi.OFMarker = No
Aug 08 23:32:20 user nova-compute[72405]: # END RECORD
Aug 08 23:32:20 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.072s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[835dd346-4eec-4635-9971-ab5893e28545]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[36617603-c540-4b89-9182-fe806267fe93]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAJdNXFn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAJdNXFn" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe38232-d89e-4d6a-8e84-afe59c3c0b1b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAJdNXFn'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21be2d8f-1d44-4078-b650-a52807442b87]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[778c7aef-f876-46b2-9f76-7b0f48810134]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:20 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:20 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:20 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:20 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:20 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:20 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:20 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:20 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] HCTL ('36', '0', '0', 0) found on session 29 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Instance destroyed successfully.
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'resources' on Instance uuid 80e7599c-bd2a-499d-9b2b-4c613f375900 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e01d9-c57c-480d-9a91-f8e977a673f8]: (4, ('0 0 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Searching for a device in session 29 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAJdNXFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.313s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] <== connect_volume: return (314ms) {'type': 'block', 'scsi_wwn': '26335366132626162', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335366132626162', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1585614820',display_name='tempest-AttachVolumeTestJSON-server-1585614820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1585614820',id=3,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8euvpxWJNO750Ett1y5l6nUBCKHU4un22U0sVC2wf4NfIUgk31Ch5+zY5y33mlbs28YrhaqP+7GQOsPP6KZPRER0rGRQRWXgUfWU0AnvhRViVtMgE5JDgi6bQQpVnBw==',key_name='tempest-keypair-1662483780',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-inouhv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=80e7599c-bd2a-499d-9b2b-4c613f375900,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "8654907e-9844-4cf4-8754-5b540b3aa53c", "address": "fa:16:3e:f6:53:af", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8654907e-98", "ovs_interfaceid": "8654907e-9844-4cf4-8754-5b540b3aa53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG os_vif [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8654907e-98, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk /opt/stack/data/nova/instances/snapshots/tmpqqkpgknu/348435518db44f41971500a501d94d97 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-452517066',display_name='tempest-ServerStableDeviceRescueTest-server-452517066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-452517066',id=18,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfb+9WmRPUuJID0aCtCuVWP3Y5xAGVKgUgc8vQE5Us4fml62cTBVbJ8SSWaqHZPlj6Uxq5guWwS0hwOkGccO0dH9ecgls3SF6jBVEpegRCE66dlBdrvcMqOKvzV/wvbHQ==',key_name='tempest-keypair-2083609225',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c875dc671b18444089e28d84beeb4bb4',ramdisk_id='',reservation_id='r-2xadwtvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-405578644',owner_user_name='tempest-ServerStableDeviceRescueTest-405578644-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24b44561b1d9485b845bc9157be71736',uuid=f7fccdf2-d173-42c4-9c04-421e7dfe6ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "vif_mac": "fa:16:3e:55:12:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converting VIF {"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "vif_mac": "fa:16:3e:55:12:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'pci_devices' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:20 user nova-compute[72405]: INFO os_vif [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:53:af,bridge_name='br-int',has_traffic_filtering=True,id=8654907e-9844-4cf4-8754-5b540b3aa53c,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8654907e-98')
Aug 08 23:32:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Deleting instance files /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900_del
Aug 08 23:32:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Deletion of /opt/stack/data/nova/instances/80e7599c-bd2a-499d-9b2b-4c613f375900_del complete
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:32:20 user nova-compute[72405]:   <uuid>f7fccdf2-d173-42c4-9c04-421e7dfe6ef0</uuid>
Aug 08 23:32:20 user nova-compute[72405]:   <name>instance-00000012</name>
Aug 08 23:32:20 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:32:20 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:32:20 user nova-compute[72405]:   <metadata>
Aug 08 23:32:20 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:32:20 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:32:20 user nova-compute[72405]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-452517066</nova:name>
Aug 08 23:32:20 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:32:19</nova:creationTime>
Aug 08 23:32:20 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:32:20 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:32:20 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:32:20 user nova-compute[72405]:       <nova:owner>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:user uuid="24b44561b1d9485b845bc9157be71736">tempest-ServerStableDeviceRescueTest-405578644-project-member</nova:user>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:project uuid="c875dc671b18444089e28d84beeb4bb4">tempest-ServerStableDeviceRescueTest-405578644</nova:project>
Aug 08 23:32:20 user nova-compute[72405]:       </nova:owner>
Aug 08 23:32:20 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:32:20 user nova-compute[72405]:       <nova:ports>
Aug 08 23:32:20 user nova-compute[72405]:         <nova:port uuid="7f005eac-6485-491f-8fdf-c65a3a2d958e">
Aug 08 23:32:20 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:32:20 user nova-compute[72405]:         </nova:port>
Aug 08 23:32:20 user nova-compute[72405]:       </nova:ports>
Aug 08 23:32:20 user nova-compute[72405]:     </nova:instance>
Aug 08 23:32:20 user nova-compute[72405]:   </metadata>
Aug 08 23:32:20 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:32:20 user nova-compute[72405]:     <system>
Aug 08 23:32:20 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:32:20 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:32:20 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:32:20 user nova-compute[72405]:       <entry name="serial">f7fccdf2-d173-42c4-9c04-421e7dfe6ef0</entry>
Aug 08 23:32:20 user nova-compute[72405]:       <entry name="uuid">f7fccdf2-d173-42c4-9c04-421e7dfe6ef0</entry>
Aug 08 23:32:20 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:32:20 user nova-compute[72405]:     </system>
Aug 08 23:32:20 user nova-compute[72405]:   </sysinfo>
Aug 08 23:32:20 user nova-compute[72405]:   <os>
Aug 08 23:32:20 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:32:20 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:32:20 user nova-compute[72405]:   </os>
Aug 08 23:32:20 user nova-compute[72405]:   <features>
Aug 08 23:32:20 user nova-compute[72405]:     <acpi/>
Aug 08 23:32:20 user nova-compute[72405]:     <apic/>
Aug 08 23:32:20 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:32:20 user nova-compute[72405]:   </features>
Aug 08 23:32:20 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:32:20 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:32:20 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:32:20 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:32:20 user nova-compute[72405]:   </clock>
Aug 08 23:32:20 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:32:20 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:32:20 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:32:20 user nova-compute[72405]:   </cpu>
Aug 08 23:32:20 user nova-compute[72405]:   <devices>
Aug 08 23:32:20 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:32:20 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:32:20 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk"/>
Aug 08 23:32:20 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:32:20 user nova-compute[72405]:     </disk>
Aug 08 23:32:20 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:32:20 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:20 user nova-compute[72405]:       <source dev="/dev/sde"/>
Aug 08 23:32:20 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:32:20 user nova-compute[72405]:       <serial>962aa7c4-12e6-44e8-a72c-074c3c3bf9f8</serial>
Aug 08 23:32:20 user nova-compute[72405]:     </disk>
Aug 08 23:32:20 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:32:20 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:32:20 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue"/>
Aug 08 23:32:20 user nova-compute[72405]:       <target dev="vdc" bus="virtio"/>
Aug 08 23:32:20 user nova-compute[72405]:       <boot order="1"/>
Aug 08 23:32:20 user nova-compute[72405]:     </disk>
Aug 08 23:32:20 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:32:20 user nova-compute[72405]:       <mac address="fa:16:3e:55:12:ff"/>
Aug 08 23:32:20 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:20 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:32:20 user nova-compute[72405]:       <target dev="tap7f005eac-64"/>
Aug 08 23:32:20 user nova-compute[72405]:     </interface>
Aug 08 23:32:20 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:32:20 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/console.log" append="off"/>
Aug 08 23:32:20 user nova-compute[72405]:     </serial>
Aug 08 23:32:20 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:32:20 user nova-compute[72405]:     <video>
Aug 08 23:32:20 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:20 user nova-compute[72405]:     </video>
Aug 08 23:32:20 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:32:20 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:32:20 user nova-compute[72405]:     </rng>
Aug 08 23:32:20 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:32:20 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:32:20 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:32:20 user nova-compute[72405]:     </memballoon>
Aug 08 23:32:20 user nova-compute[72405]:   </devices>
Aug 08 23:32:20 user nova-compute[72405]: </domain>
Aug 08 23:32:20 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:32:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance destroyed successfully.
Aug 08 23:32:20 user nova-compute[72405]: INFO nova.compute.manager [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 08 23:32:20 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] No VIF found with MAC fa:16:3e:55:12:ff, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk /opt/stack/data/nova/instances/snapshots/tmpqqkpgknu/348435518db44f41971500a501d94d97" returned: 0 in 0.830s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Snapshot extracted, beginning image upload
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:21 user nova-compute[72405]: WARNING nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state active and task_state shelving_image_uploading.
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-unplugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Acquiring lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] No waiting events found dispatching network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:21 user nova-compute[72405]: WARNING nova.compute.manager [req-388449b8-331a-4d53-a047-de56ba7c25a5 req-8e938d3d-1641-40aa-a6e3-b7fe3f180264 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received unexpected event network-vif-plugged-8654907e-9844-4cf4-8754-5b540b3aa53c for instance with vm_state active and task_state deleting.
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:21 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Took 1.10 seconds to deallocate network for instance.
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-dcdc7965-c1a5-4042-a528-6fe09128b03c req-a7c50c1e-38eb-4994-8a4a-bbbde4319e34 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Received event network-vif-deleted-8654907e-9844-4cf4-8754-5b540b3aa53c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:21 user nova-compute[72405]: INFO nova.compute.manager [req-dcdc7965-c1a5-4042-a528-6fe09128b03c req-a7c50c1e-38eb-4994-8a4a-bbbde4319e34 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Neutron deleted interface 8654907e-9844-4cf4-8754-5b540b3aa53c; detaching it from the instance and deleting it from the info cache
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.network.neutron [req-dcdc7965-c1a5-4042-a528-6fe09128b03c req-a7c50c1e-38eb-4994-8a4a-bbbde4319e34 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-dcdc7965-c1a5-4042-a528-6fe09128b03c req-a7c50c1e-38eb-4994-8a4a-bbbde4319e34 service nova] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Detach interface failed, port_id=8654907e-9844-4cf4-8754-5b540b3aa53c, reason: Instance 80e7599c-bd2a-499d-9b2b-4c613f375900 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:22 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Deleted allocations for instance 80e7599c-bd2a-499d-9b2b-4c613f375900
Aug 08 23:32:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e72c462a-74f6-47b8-be48-fb92fadeaea2 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "80e7599c-bd2a-499d-9b2b-4c613f375900" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537528.5935593, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:23 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Stopped (Lifecycle Event)
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2c4b4947-5e6e-49c3-8d6c-e217dd862ff9 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2c4b4947-5e6e-49c3-8d6c-e217dd862ff9 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:23 user nova-compute[72405]: INFO nova.compute.manager [None req-2c4b4947-5e6e-49c3-8d6c-e217dd862ff9 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:23 user nova-compute[72405]: WARNING nova.compute.manager [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state active and task_state rescuing.
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:23 user nova-compute[72405]: WARNING nova.compute.manager [req-b4177b05-261f-40e8-b375-81e8f62006ef req-aaf1bb0c-0039-45bb-85c4-5511c9d01478 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state active and task_state rescuing.
Aug 08 23:32:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:24 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Snapshot image upload complete
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:24 user nova-compute[72405]: INFO nova.compute.manager [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Shelve offloading
Aug 08 23:32:24 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance destroyed successfully.
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537544.9438477, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:24 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Resumed (Lifecycle Event)
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-85fba702-3558-462d-8649-6ff1f70b795b tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:25 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 08 23:32:25 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537544.9485552, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:25 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Started (Lifecycle Event)
Aug 08 23:32:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Starting finish_migration {{(pid=72405) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:32:26 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Creating image(s)
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.objects.instance [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk. size=21474836480 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk 21474836480 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk 21474836480" returned: 0 in 0.073s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Ensure instance console log exists: /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start _get_guest_xml network_info=[{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1dce545f-3e65-4aab-b97e-c5590934c60b', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9f105082-c7cc-4b7d-b6d4-04a293e832cf', 'attached_at': '2023-08-08T23:32:26.000000', 'detached_at': '', 'volume_id': 'c092ae02-9d27-42ef-b4c5-f0953aa54ead', 'serial': 'c092ae02-9d27-42ef-b4c5-f0953aa54ead'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:32:26 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:26 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.objects.instance [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:26 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:26 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:26 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76b04f8-82f0-4645-a06d-19cff9e3c26e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:32:26 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f691a8e-ae24-4fe2-8a22-320aa78d9c1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead] added
Aug 08 23:32:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2152f-845e-45b4-baa2-389247609bbd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b9cf90-c5f9-450f-b682-0b86f93b8df7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQAdeXBW {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQAdeXBW" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9b5ab-88b7-4394-aee9-20c40df0dcd7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQAdeXBW'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5fa63b-74da-41ae-a310-722facb1632d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd2b299-cd2d-4261-9e67-97ee943e800f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c22206a-70dc-46dc-949d-74db1506682a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]
Aug 08 23:32:26 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd709ca-bb7a-440a-be65-d7f151906295]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c8128-b37f-4774-844b-b43f8c26f056]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:26 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:32:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.039s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b56a1-7978-4df4-a45d-9c1b5acd0ce5]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:32:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance destroyed successfully.
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'resources' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330613417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330613417',id=24,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZrgB0t8FyEc9XDJAEVKchd2UHxZI2ndPwoMOm/H4NoEIISPQHebEz1f8EBd0SrxcatAlMw7TVzErTi2xbmATOuOsUFaBACHBYZ8KKF/5KEAQ8mhYCsUoodnumvFPn70g==',key_name='tempest-keypair-779216247',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-gjwgg0im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member',shelved_at='2023-08-08T23:32:24.682693',shelved_host='user',shelved_image_id='2d45eff0-7fe7-45e2-a945-5682230d1aa6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=3ff81abc-acf0-4d6e-b88b-3db62c9f9080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG os_vif [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap418e6ca5-f5, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-changed-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.compute.manager [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing instance network info cache due to event network-changed-418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.network.neutron [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:27 user nova-compute[72405]: INFO os_vif [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5')
Aug 08 23:32:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Deleting instance files /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080_del
Aug 08 23:32:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Deletion of /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080_del complete
Aug 08 23:32:27 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Deleted allocations for instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '26439356237323937', 'path': '/dev/sdf'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439356237323937', 'path': '/dev/sdf'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e95c1bb-8464-4835-89db-9d1a86e26dc2 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.303s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:32:28 user nova-compute[72405]:   <uuid>9f105082-c7cc-4b7d-b6d4-04a293e832cf</uuid>
Aug 08 23:32:28 user nova-compute[72405]:   <name>instance-00000011</name>
Aug 08 23:32:28 user nova-compute[72405]:   <memory>2097152</memory>
Aug 08 23:32:28 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:32:28 user nova-compute[72405]:   <metadata>
Aug 08 23:32:28 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:32:28 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:32:28 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherB-server-1050796295</nova:name>
Aug 08 23:32:28 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:32:26</nova:creationTime>
Aug 08 23:32:28 user nova-compute[72405]:       <nova:flavor name="m1.small">
Aug 08 23:32:28 user nova-compute[72405]:         <nova:memory>2048</nova:memory>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:disk>20</nova:disk>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:32:28 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:32:28 user nova-compute[72405]:       <nova:owner>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:user uuid="1fced4d4747e4e3abb0772b956bedba7">tempest-ServerActionsTestOtherB-1153417891-project-member</nova:user>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:project uuid="af7781e7654e447fb13a10725e45a2fe">tempest-ServerActionsTestOtherB-1153417891</nova:project>
Aug 08 23:32:28 user nova-compute[72405]:       </nova:owner>
Aug 08 23:32:28 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:32:28 user nova-compute[72405]:       <nova:ports>
Aug 08 23:32:28 user nova-compute[72405]:         <nova:port uuid="f9f2e3cc-1e64-475b-9e4a-f1a0db25b771">
Aug 08 23:32:28 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:32:28 user nova-compute[72405]:         </nova:port>
Aug 08 23:32:28 user nova-compute[72405]:       </nova:ports>
Aug 08 23:32:28 user nova-compute[72405]:     </nova:instance>
Aug 08 23:32:28 user nova-compute[72405]:   </metadata>
Aug 08 23:32:28 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:32:28 user nova-compute[72405]:     <system>
Aug 08 23:32:28 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:32:28 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:32:28 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:32:28 user nova-compute[72405]:       <entry name="serial">9f105082-c7cc-4b7d-b6d4-04a293e832cf</entry>
Aug 08 23:32:28 user nova-compute[72405]:       <entry name="uuid">9f105082-c7cc-4b7d-b6d4-04a293e832cf</entry>
Aug 08 23:32:28 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:32:28 user nova-compute[72405]:     </system>
Aug 08 23:32:28 user nova-compute[72405]:   </sysinfo>
Aug 08 23:32:28 user nova-compute[72405]:   <os>
Aug 08 23:32:28 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:32:28 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:32:28 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:32:28 user nova-compute[72405]:   </os>
Aug 08 23:32:28 user nova-compute[72405]:   <features>
Aug 08 23:32:28 user nova-compute[72405]:     <acpi/>
Aug 08 23:32:28 user nova-compute[72405]:     <apic/>
Aug 08 23:32:28 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:32:28 user nova-compute[72405]:   </features>
Aug 08 23:32:28 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:32:28 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:32:28 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:32:28 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:32:28 user nova-compute[72405]:   </clock>
Aug 08 23:32:28 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:32:28 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:32:28 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:32:28 user nova-compute[72405]:   </cpu>
Aug 08 23:32:28 user nova-compute[72405]:   <devices>
Aug 08 23:32:28 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:32:28 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:32:28 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk"/>
Aug 08 23:32:28 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:32:28 user nova-compute[72405]:     </disk>
Aug 08 23:32:28 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:32:28 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:28 user nova-compute[72405]:       <source dev="/dev/sdf"/>
Aug 08 23:32:28 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:32:28 user nova-compute[72405]:       <serial>c092ae02-9d27-42ef-b4c5-f0953aa54ead</serial>
Aug 08 23:32:28 user nova-compute[72405]:     </disk>
Aug 08 23:32:28 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:32:28 user nova-compute[72405]:       <mac address="fa:16:3e:2f:cf:a3"/>
Aug 08 23:32:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:28 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:32:28 user nova-compute[72405]:       <target dev="tapf9f2e3cc-1e"/>
Aug 08 23:32:28 user nova-compute[72405]:     </interface>
Aug 08 23:32:28 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:32:28 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/console.log" append="off"/>
Aug 08 23:32:28 user nova-compute[72405]:     </serial>
Aug 08 23:32:28 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:32:28 user nova-compute[72405]:     <video>
Aug 08 23:32:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:28 user nova-compute[72405]:     </video>
Aug 08 23:32:28 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:32:28 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:32:28 user nova-compute[72405]:     </rng>
Aug 08 23:32:28 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:32:28 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:32:28 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:32:28 user nova-compute[72405]:     </memballoon>
Aug 08 23:32:28 user nova-compute[72405]:   </devices>
Aug 08 23:32:28 user nova-compute[72405]: </domain>
Aug 08 23:32:28 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1195838920-network", "vif_mac": "fa:16:3e:2f:cf:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG os_vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.network.neutron [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updated VIF entry in instance network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.network.neutron [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9f2e3cc-1e, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9f2e3cc-1e, col_values=(('external_ids', {'iface-id': 'f9f2e3cc-1e64-475b-9e4a-f1a0db25b771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:cf:a3', 'vm-uuid': '9f105082-c7cc-4b7d-b6d4-04a293e832cf'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-60f417ff-ed33-4bb3-a697-62d616786c66 req-c211fbe0-318f-4ae1-a456-00064307bb91 service nova] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:28 user nova-compute[72405]: INFO os_vif [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e')
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] No VIF found with MAC fa:16:3e:2f:cf:a3, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:29 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:32:29 user nova-compute[72405]: INFO nova.compute.claims [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Claim successful on node user
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ce591d4f-8d91-4480-9d6c-e9e98351a47e req-bafcb34a-996e-44d7-8477-f4d6c2efcc66 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ce591d4f-8d91-4480-9d6c-e9e98351a47e req-bafcb34a-996e-44d7-8477-f4d6c2efcc66 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ce591d4f-8d91-4480-9d6c-e9e98351a47e req-bafcb34a-996e-44d7-8477-f4d6c2efcc66 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ce591d4f-8d91-4480-9d6c-e9e98351a47e req-bafcb34a-996e-44d7-8477-f4d6c2efcc66 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ce591d4f-8d91-4480-9d6c-e9e98351a47e req-bafcb34a-996e-44d7-8477-f4d6c2efcc66 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:30 user nova-compute[72405]: WARNING nova.compute.manager [req-ce591d4f-8d91-4480-9d6c-e9e98351a47e req-bafcb34a-996e-44d7-8477-f4d6c2efcc66 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state active and task_state resize_finish.
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:32:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:32:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.policy [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4881dc8c73248bb9ccaabc9aa0b485c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10125c137a084adfaf04047babb4e183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:32:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Creating image(s)
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "/opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "/opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "/opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk 1073741824" returned: 0 in 0.058s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Successfully created port: d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Cannot resize image /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG nova.objects.instance [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lazy-loading 'migration_context' on Instance uuid befa7939-87a3-4258-9d44-dd986d9d5ea4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Ensure instance console log exists: /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537552.0997174, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:32 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Resumed (Lifecycle Event)
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:32 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance running successfully.
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Failed to set time: agent not configured {{(pid=72405) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-be9e22a0-4f06-4aa3-bd53-5f5896285acc tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] finish_migration finished successfully. {{(pid=72405) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:32 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537552.1051288, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:32 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Started (Lifecycle Event)
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:32 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-c0123ece-cb0a-4f1d-9f88-7d0a494b88a1 req-f2ddb7b6-cda9-45a8-bf0e-fb38b45c2cb6 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c0123ece-cb0a-4f1d-9f88-7d0a494b88a1 req-f2ddb7b6-cda9-45a8-bf0e-fb38b45c2cb6 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c0123ece-cb0a-4f1d-9f88-7d0a494b88a1 req-f2ddb7b6-cda9-45a8-bf0e-fb38b45c2cb6 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c0123ece-cb0a-4f1d-9f88-7d0a494b88a1 req-f2ddb7b6-cda9-45a8-bf0e-fb38b45c2cb6 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-c0123ece-cb0a-4f1d-9f88-7d0a494b88a1 req-f2ddb7b6-cda9-45a8-bf0e-fb38b45c2cb6 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:32 user nova-compute[72405]: WARNING nova.compute.manager [req-c0123ece-cb0a-4f1d-9f88-7d0a494b88a1 req-f2ddb7b6-cda9-45a8-bf0e-fb38b45c2cb6 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state active and task_state resize_finish.
Aug 08 23:32:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:32 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:32 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:32 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91bae29-1f15-4b08-a154-b1cac70be6f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:32:32 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b976697-99ab-4f8f-8ddb-15b5413e94bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0] added
Aug 08 23:32:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e15ba22-b7cb-4ade-98f0-4c1ece621f4b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a1a7c9-c459-4bae-a3eb-402dc16b5144]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPzGmMkB {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPzGmMkB" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6dc1e-1f1e-489d-9e63-151901a168b0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qPzGmMkB'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84ff6e-ad79-4f8f-ac05-af5b57a502d0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ae9f27-9ac5-4285-8a77-0fb70b25050b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ddea8-885c-4951-a367-9d084637734f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]
Aug 08 23:32:32 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d89d66-8b49-4d34-acc9-1ad7f07c186d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9995b3-cc76-420b-a532-588cd69bd2f0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:32 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:32 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7e97a-e95c-44a3-af52-22d58fe6acda]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:32 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Successfully updated port: d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "refresh_cache-befa7939-87a3-4258-9d44-dd986d9d5ea4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquired lock "refresh_cache-befa7939-87a3-4258-9d44-dd986d9d5ea4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:33 user nova-compute[72405]: INFO nova.compute.manager [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Detaching volume fc09a945-e122-4faa-a526-698e4622393f
Aug 08 23:32:33 user nova-compute[72405]: INFO nova.virt.block_device [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Attempting to driver detach volume fc09a945-e122-4faa-a526-698e4622393f from mountpoint /dev/vdb
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Attempting to detach device vdb from instance 466645d2-64fb-4c97-899a-1997a0ef4bca from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:32:33 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:33 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:32:33 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:32:33 user nova-compute[72405]:   <serial>fc09a945-e122-4faa-a526-698e4622393f</serial>
Aug 08 23:32:33 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:32:33 user nova-compute[72405]: </disk>
Aug 08 23:32:33 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:32:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully detached device vdb from instance 466645d2-64fb-4c97-899a-1997a0ef4bca from the persistent domain config.
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 466645d2-64fb-4c97-899a-1997a0ef4bca from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:32:33 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:33 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:32:33 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:32:33 user nova-compute[72405]:   <serial>fc09a945-e122-4faa-a526-698e4622393f</serial>
Aug 08 23:32:33 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:32:33 user nova-compute[72405]: </disk>
Aug 08 23:32:33 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Updating instance_info_cache with network_info: [{"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Releasing lock "refresh_cache-befa7939-87a3-4258-9d44-dd986d9d5ea4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Instance network_info: |[{"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Start _get_guest_xml network_info=[{"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:32:33 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:33 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:32:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1932563391',display_name='tempest-VolumesActionsTest-instance-1932563391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1932563391',id=26,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10125c137a084adfaf04047babb4e183',ramdisk_id='',reservation_id='r-fgci1u46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053940124',owner_user_name='tempest-VolumesActionsTest-2053940124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:31Z,user_data=None,user_id='d4881dc8c73248bb9ccaabc9aa0b485c',uuid=befa7939-87a3-4258-9d44-dd986d9d5ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Converting VIF {"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.objects.instance [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lazy-loading 'pci_devices' on Instance uuid befa7939-87a3-4258-9d44-dd986d9d5ea4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23161633137393634', 'path': '/dev/sdg'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161633137393634', 'path': '/dev/sdg'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'flavor' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:32:33 user nova-compute[72405]:   <uuid>befa7939-87a3-4258-9d44-dd986d9d5ea4</uuid>
Aug 08 23:32:33 user nova-compute[72405]:   <name>instance-0000001a</name>
Aug 08 23:32:33 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:32:33 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:32:33 user nova-compute[72405]:   <metadata>
Aug 08 23:32:33 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:32:33 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:32:33 user nova-compute[72405]:       <nova:name>tempest-VolumesActionsTest-instance-1932563391</nova:name>
Aug 08 23:32:33 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:32:33</nova:creationTime>
Aug 08 23:32:33 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:32:33 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:32:33 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:32:33 user nova-compute[72405]:       <nova:owner>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:user uuid="d4881dc8c73248bb9ccaabc9aa0b485c">tempest-VolumesActionsTest-2053940124-project-member</nova:user>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:project uuid="10125c137a084adfaf04047babb4e183">tempest-VolumesActionsTest-2053940124</nova:project>
Aug 08 23:32:33 user nova-compute[72405]:       </nova:owner>
Aug 08 23:32:33 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:32:33 user nova-compute[72405]:       <nova:ports>
Aug 08 23:32:33 user nova-compute[72405]:         <nova:port uuid="d0d7b689-0c6b-493c-afc1-d82f5fb454a8">
Aug 08 23:32:33 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:32:33 user nova-compute[72405]:         </nova:port>
Aug 08 23:32:33 user nova-compute[72405]:       </nova:ports>
Aug 08 23:32:33 user nova-compute[72405]:     </nova:instance>
Aug 08 23:32:33 user nova-compute[72405]:   </metadata>
Aug 08 23:32:33 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:32:33 user nova-compute[72405]:     <system>
Aug 08 23:32:33 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:32:33 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:32:33 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:32:33 user nova-compute[72405]:       <entry name="serial">befa7939-87a3-4258-9d44-dd986d9d5ea4</entry>
Aug 08 23:32:33 user nova-compute[72405]:       <entry name="uuid">befa7939-87a3-4258-9d44-dd986d9d5ea4</entry>
Aug 08 23:32:33 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:32:33 user nova-compute[72405]:     </system>
Aug 08 23:32:33 user nova-compute[72405]:   </sysinfo>
Aug 08 23:32:33 user nova-compute[72405]:   <os>
Aug 08 23:32:33 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:32:33 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:32:33 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:32:33 user nova-compute[72405]:   </os>
Aug 08 23:32:33 user nova-compute[72405]:   <features>
Aug 08 23:32:33 user nova-compute[72405]:     <acpi/>
Aug 08 23:32:33 user nova-compute[72405]:     <apic/>
Aug 08 23:32:33 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:32:33 user nova-compute[72405]:   </features>
Aug 08 23:32:33 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:32:33 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:32:33 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:32:33 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:32:33 user nova-compute[72405]:   </clock>
Aug 08 23:32:33 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:32:33 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:32:33 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:32:33 user nova-compute[72405]:   </cpu>
Aug 08 23:32:33 user nova-compute[72405]:   <devices>
Aug 08 23:32:33 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:32:33 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:32:33 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk"/>
Aug 08 23:32:33 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:32:33 user nova-compute[72405]:     </disk>
Aug 08 23:32:33 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:32:33 user nova-compute[72405]:       <mac address="fa:16:3e:b6:38:46"/>
Aug 08 23:32:33 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:33 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:32:33 user nova-compute[72405]:       <target dev="tapd0d7b689-0c"/>
Aug 08 23:32:33 user nova-compute[72405]:     </interface>
Aug 08 23:32:33 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:32:33 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/console.log" append="off"/>
Aug 08 23:32:33 user nova-compute[72405]:     </serial>
Aug 08 23:32:33 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:32:33 user nova-compute[72405]:     <video>
Aug 08 23:32:33 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:33 user nova-compute[72405]:     </video>
Aug 08 23:32:33 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:32:33 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:32:33 user nova-compute[72405]:     </rng>
Aug 08 23:32:33 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:32:33 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:32:33 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:32:33 user nova-compute[72405]:     </memballoon>
Aug 08 23:32:33 user nova-compute[72405]:   </devices>
Aug 08 23:32:33 user nova-compute[72405]: </domain>
Aug 08 23:32:33 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:32:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1932563391',display_name='tempest-VolumesActionsTest-instance-1932563391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1932563391',id=26,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10125c137a084adfaf04047babb4e183',ramdisk_id='',reservation_id='r-fgci1u46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053940124',owner_user_name='tempest-VolumesActionsTest-2053940124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:31Z,user_data=None,user_id='d4881dc8c73248bb9ccaabc9aa0b485c',uuid=befa7939-87a3-4258-9d44-dd986d9d5ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Converting VIF {"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_vif [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0d7b689-0c, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0d7b689-0c, col_values=(('external_ids', {'iface-id': 'd0d7b689-0c6b-493c-afc1-d82f5fb454a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:38:46', 'vm-uuid': 'befa7939-87a3-4258-9d44-dd986d9d5ea4'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:33 user nova-compute[72405]: INFO os_vif [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c')
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:32:33 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:33 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:32:33 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:32:33 user nova-compute[72405]:   <serial>0f3fca48-1880-4f2c-9873-528ae41fdcc0</serial>
Aug 08 23:32:33 user nova-compute[72405]: </disk>
Aug 08 23:32:33 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] No VIF found with MAC fa:16:3e:b6:38:46, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537553.9771743, 466645d2-64fb-4c97-899a-1997a0ef4bca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:32:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully detached device vdb from instance 466645d2-64fb-4c97-899a-1997a0ef4bca from the live domain config.
Aug 08 23:32:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMpqCrNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:33 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:32:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ce2c43-47df-46ac-9fbd-213722547409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afbbfa-c188-47e0-a751-7432e35ee275]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:34 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb982041f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c4519-773c-4841-a83c-e41c740967f4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641f300-3d67-4992-b183-fdce92698781]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e70c6-d674-4db9-b2d4-85fde2385474]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6172259-817b-4987-a3ee-26a4b19d010f]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf729113-19b3-475e-aa8e-a59140ce5264]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb90a3a-a829-4bc2-90fa-37116ae04370]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260]
Aug 08 23:32:34 user nova-compute[72405]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-changed-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Refreshing instance network info cache due to event network-changed-d0d7b689-0c6b-493c-afc1-d82f5fb454a8. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] Acquiring lock "refresh_cache-befa7939-87a3-4258-9d44-dd986d9d5ea4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] Acquired lock "refresh_cache-befa7939-87a3-4258-9d44-dd986d9d5ea4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.network.neutron [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Refreshing network info cache for port d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[63119ca4-304a-4d1c-a481-17591f0261eb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== disconnect_volume: return (350ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.network.neutron [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Updated VIF entry in instance network info cache for port d0d7b689-0c6b-493c-afc1-d82f5fb454a8. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.network.neutron [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Updating instance_info_cache with network_info: [{"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537539.8591237, 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:34 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] VM Stopped (Lifecycle Event)
Aug 08 23:32:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-98137f04-0d4d-4128-96b6-08ab91402ecf req-d55ba83d-e1bc-4e48-b21d-0c9128f8b46e service nova] Releasing lock "refresh_cache-befa7939-87a3-4258-9d44-dd986d9d5ea4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-4f0c7ffd-f0db-4a0e-8732-32445cbb3284 None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No VIF found with MAC fa:16:3e:0c:91:38, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'flavor' on Instance uuid 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537540.264999, 80e7599c-bd2a-499d-9b2b-4c613f375900 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:35 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] VM Stopped (Lifecycle Event)
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f1b489b3-556f-455a-8266-ac4b69bdeeeb None None] [instance: 80e7599c-bd2a-499d-9b2b-4c613f375900] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f5903a2e-2d66-4aca-95b1-62e5f0624087 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.863s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.726s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:35 user nova-compute[72405]: INFO nova.compute.manager [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Terminating instance
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a36f6bfc-c12f-46c7-b01b-071af5979508 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.815s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-3d3d9168-f1c5-4d7e-b13c-662076a81db1 req-53c6fd69-e453-4ea6-ad89-f90df0c1ffc7 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-unplugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3d3d9168-f1c5-4d7e-b13c-662076a81db1 req-53c6fd69-e453-4ea6-ad89-f90df0c1ffc7 service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3d3d9168-f1c5-4d7e-b13c-662076a81db1 req-53c6fd69-e453-4ea6-ad89-f90df0c1ffc7 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3d3d9168-f1c5-4d7e-b13c-662076a81db1 req-53c6fd69-e453-4ea6-ad89-f90df0c1ffc7 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-3d3d9168-f1c5-4d7e-b13c-662076a81db1 req-53c6fd69-e453-4ea6-ad89-f90df0c1ffc7 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-unplugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-3d3d9168-f1c5-4d7e-b13c-662076a81db1 req-53c6fd69-e453-4ea6-ad89-f90df0c1ffc7 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-unplugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Instance destroyed successfully.
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.objects.instance [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'resources' on Instance uuid 466645d2-64fb-4c97-899a-1997a0ef4bca {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-985242216',display_name='tempest-VolumesSnapshotTestJSON-instance-985242216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-985242216',id=23,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdvP+LBbAV1KZ4laNfMtAUScmNbsYPwCsZwz5asSfj9IYTgZhu+pY/M0NjjOIIR1YpOq54uC1DEZ7rIVDIvh1FZEVjLt6yKGNj1JoD/Iku486GUXj04oJunyqG7+jr2ug==',key_name='tempest-keypair-2090972308',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75e9333fa38e4335ae6b2eabc3a579c0',ramdisk_id='',reservation_id='r-eop4hfu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1813381307',owner_user_name='tempest-VolumesSnapshotTestJSON-1813381307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a44d888f97048c9b47154e7700bb9fa',uuid=466645d2-64fb-4c97-899a-1997a0ef4bca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converting VIF {"id": "3f28230e-aa3c-4173-8904-fa38542e2554", "address": "fa:16:3e:e5:34:56", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f28230e-aa", "ovs_interfaceid": "3f28230e-aa3c-4173-8904-fa38542e2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_vif [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f28230e-aa, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: INFO os_vif [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:34:56,bridge_name='br-int',has_traffic_filtering=True,id=3f28230e-aa3c-4173-8904-fa38542e2554,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f28230e-aa')
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMpqCrNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:36 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc09a945-e122-4faa-a526-698e4622393f', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e78d51-82e9-49c7-a036-e16586454295]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045bbbc-8d71-4ed9-9ca4-c61562cc8bc3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:36 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f8beb0>, {}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Disconnecting from: [] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.108s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== disconnect_volume: return (109ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:32:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Deleting instance files /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca_del
Aug 08 23:32:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Deletion of /opt/stack/data/nova/instances/466645d2-64fb-4c97-899a-1997a0ef4bca_del complete
Aug 08 23:32:36 user nova-compute[72405]: INFO nova.compute.manager [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 08 23:32:36 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:32:36 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:32:37 user nova-compute[72405]: INFO nova.compute.manager [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Rebuilding instance
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'pci_requests' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'pci_devices' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'resources' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:37 user nova-compute[72405]: WARNING nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received unexpected event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with vm_state active and task_state deleting.
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] No waiting events found dispatching network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:37 user nova-compute[72405]: WARNING nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received unexpected event network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 for instance with vm_state building and task_state spawning.
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] No waiting events found dispatching network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:37 user nova-compute[72405]: WARNING nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received unexpected event network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 for instance with vm_state building and task_state spawning.
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:37 user nova-compute[72405]: WARNING nova.compute.manager [req-761b44c7-86f6-4b81-8c30-592d84ca92bc req-749b667d-38e1-4a44-8b20-1866da4c5231 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received unexpected event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with vm_state active and task_state deleting.
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'migration_context' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72405) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:38 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Took 1.50 seconds to deallocate network for instance.
Aug 08 23:32:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-289a0f49-9757-44f1-941a-85dfba196254 req-3d84b977-44d5-43a8-9d5c-929fe7f5cec5 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-deleted-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:38 user nova-compute[72405]: WARNING nova.volume.cinder [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Attachment 5e24af5d-0cea-4f21-87eb-a21bd2de67d3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5e24af5d-0cea-4f21-87eb-a21bd2de67d3. (HTTP 404) (Request-ID: req-87541f80-b542-4c6c-9530-3595e3722a09)
Aug 08 23:32:38 user nova-compute[72405]: INFO nova.compute.manager [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Took 0.04 seconds to detach 1 volumes for instance.
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-b3178888-cc41-438b-b74d-40c994ddfad6 req-d6be58ac-4fb5-4a2e-a54d-12b1bbc2026e service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-unplugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b3178888-cc41-438b-b74d-40c994ddfad6 req-d6be58ac-4fb5-4a2e-a54d-12b1bbc2026e service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b3178888-cc41-438b-b74d-40c994ddfad6 req-d6be58ac-4fb5-4a2e-a54d-12b1bbc2026e service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b3178888-cc41-438b-b74d-40c994ddfad6 req-d6be58ac-4fb5-4a2e-a54d-12b1bbc2026e service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-b3178888-cc41-438b-b74d-40c994ddfad6 req-d6be58ac-4fb5-4a2e-a54d-12b1bbc2026e service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-unplugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:38 user nova-compute[72405]: WARNING nova.compute.manager [req-b3178888-cc41-438b-b74d-40c994ddfad6 req-d6be58ac-4fb5-4a2e-a54d-12b1bbc2026e service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-unplugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state active and task_state rebuilding.
Aug 08 23:32:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance destroyed successfully.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.623s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537559.1459513, befa7939-87a3-4258-9d44-dd986d9d5ea4 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] VM Resumed (Lifecycle Event)
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.579s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Instance spawned successfully.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Detaching volume 0f3fca48-1880-4f2c-9873-528ae41fdcc0
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Deleted allocations for instance 466645d2-64fb-4c97-899a-1997a0ef4bca
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537559.1499743, befa7939-87a3-4258-9d44-dd986d9d5ea4 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] VM Started (Lifecycle Event)
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.virt.block_device [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attempting to driver detach volume 0f3fca48-1880-4f2c-9873-528ae41fdcc0 from mountpoint /dev/vdb
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73a4a5b1-5447-4df3-b34a-1b0edcdd7f5d tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.048s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Attempting to detach device vdb from instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:32:39 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:39 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:32:39 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:32:39 user nova-compute[72405]:   <serial>0f3fca48-1880-4f2c-9873-528ae41fdcc0</serial>
Aug 08 23:32:39 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:32:39 user nova-compute[72405]: </disk>
Aug 08 23:32:39 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully detached device vdb from instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 from the persistent domain config.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:39 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e97927-046f-457e-82a4-c339da7e6ee8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Took 8.73 seconds to spawn the instance on the hypervisor.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a1a8a5-30c4-40aa-8ce1-35a2fddf5711]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:39 user nova-compute[72405]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f3d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'): ({'sdg'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Removing single pathed devices sdg {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc6582-8175-4d9e-8d26-0c3eba9071ea]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa078a8b-5b05-440a-8b9d-ef1c0a87d98a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flushing IO for device /dev/sdg {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[26025739-d7ff-493d-8fa5-b07c4bcd4512]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: INFO nova.compute.manager [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Took 9.82 seconds to build instance.
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.065s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b69e5a-427f-4757-97f9-efd60a099d84]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-22e6e003-4cb1-4b9d-b4f4-e696ee9e46cc tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.982s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9e68c-392f-4752-8b8f-8c93249cc977]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9399b68-dd72-4fbc-ae46-21ac34f8a9ea]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]
Aug 08 23:32:39 user nova-compute[72405]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e5d34-d45b-4434-8371-c0dec13cab72]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== disconnect_volume: return (505ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:32:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:40 user nova-compute[72405]: WARNING nova.compute.manager [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received unexpected event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with vm_state deleted and task_state None.
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] Acquiring lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] Lock "466645d2-64fb-4c97-899a-1997a0ef4bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] No waiting events found dispatching network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:40 user nova-compute[72405]: WARNING nova.compute.manager [req-d9940058-5db5-4351-97c5-68e370d185ba req-366ebff6-357f-4cf8-b708-ddd41dd103d1 service nova] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Received unexpected event network-vif-plugged-3f28230e-aa3c-4173-8904-fa38542e2554 for instance with vm_state deleted and task_state None.
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-302db704-78e6-4ca9-89e8-0a919e97fafd req-f20eaf4a-d60a-497a-9c33-d76ea37f599f service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-302db704-78e6-4ca9-89e8-0a919e97fafd req-f20eaf4a-d60a-497a-9c33-d76ea37f599f service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-302db704-78e6-4ca9-89e8-0a919e97fafd req-f20eaf4a-d60a-497a-9c33-d76ea37f599f service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-302db704-78e6-4ca9-89e8-0a919e97fafd req-f20eaf4a-d60a-497a-9c33-d76ea37f599f service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-302db704-78e6-4ca9-89e8-0a919e97fafd req-f20eaf4a-d60a-497a-9c33-d76ea37f599f service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:40 user nova-compute[72405]: WARNING nova.compute.manager [req-302db704-78e6-4ca9-89e8-0a919e97fafd req-f20eaf4a-d60a-497a-9c33-d76ea37f599f service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state active and task_state rebuilding.
Aug 08 23:32:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance destroyed successfully.
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525172976',display_name='tempest-ServerActionsTestOtherA-server-55724933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525172976',id=21,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-eqwjzdat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=e5fc6348-e237-4f86-8179-c5dc34b9e1d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG os_vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac5523e-98, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:40 user nova-compute[72405]: INFO os_vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98')
Aug 08 23:32:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:40 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:32:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:32:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33826a1-3bad-4a6d-b898-0675931455c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[363c9d22-aaa9-4905-8360-207128199867]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:41 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:41 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:41 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:41 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:41 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:41 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:41 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:41 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7c15f30>, {}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Disconnecting from: [] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== disconnect_volume: return (99ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:32:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Deleting instance files /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2_del
Aug 08 23:32:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Deletion of /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2_del complete
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: INFO nova.virt.block_device [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Booting with volume 0f3fca48-1880-4f2c-9873-528ae41fdcc0 at /dev/vdb
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.utils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90f88b-cda1-4c65-a9c4-f0b4b4f6dcf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a872f2d7-0490-48f3-96c9-18178f6d6078]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[032ffa72-f50b-408b-8b7d-261f7dccf4d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde88ca7-68db-492a-962b-d59cc2986a1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:32:41 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b2a5a-e387-43f9-ac78-27ff847ee964]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG os_brick.utils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating existing volume attachment record: 5771273e-c448-451a-ba85-c67962cc778c {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'e5fc6348-e237-4f86-8179-c5dc34b9e1d2' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e5fc6348-e237-4f86-8179-c5dc34b9e1d2' (instance-00000015)
Aug 08 23:32:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7726MB free_disk=25.220500946044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Applying migration context for instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf as it has an incoming, in-progress migration 6af202c9-a8e7-43bf-affd-7985a25456c1. Migration status is finished {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 08 23:32:42 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating resource usage from migration 6af202c9-a8e7-43bf-affd-7985a25456c1
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance cc8aece0-15d7-4e9d-994a-3a2592246f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 30ae278e-aa85-4896-84a1-a5301f5c5ccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Migration 6af202c9-a8e7-43bf-affd-7985a25456c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance befa7939-87a3-4258-9d44-dd986d9d5ea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:32:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:32:43 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:43 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:43 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:32:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:32:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:48 user nova-compute[72405]: INFO nova.compute.manager [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Terminating instance
Aug 08 23:32:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-0c78231b-75ad-4ad0-bf86-81aea0e3cd30 req-ef91b017-403b-4843-b7d8-9e3736a46dfe service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-vif-unplugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0c78231b-75ad-4ad0-bf86-81aea0e3cd30 req-ef91b017-403b-4843-b7d8-9e3736a46dfe service nova] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0c78231b-75ad-4ad0-bf86-81aea0e3cd30 req-ef91b017-403b-4843-b7d8-9e3736a46dfe service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0c78231b-75ad-4ad0-bf86-81aea0e3cd30 req-ef91b017-403b-4843-b7d8-9e3736a46dfe service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-0c78231b-75ad-4ad0-bf86-81aea0e3cd30 req-ef91b017-403b-4843-b7d8-9e3736a46dfe service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] No waiting events found dispatching network-vif-unplugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-0c78231b-75ad-4ad0-bf86-81aea0e3cd30 req-ef91b017-403b-4843-b7d8-9e3736a46dfe service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-vif-unplugged-f7593a45-a32e-4150-ae32-f85caf5643c4 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:32:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Instance destroyed successfully.
Aug 08 23:32:49 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'resources' on Instance uuid cc8aece0-15d7-4e9d-994a-3a2592246f8a {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303472658',display_name='tempest-AttachVolumeNegativeTest-server-303472658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303472658',id=22,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHE37yoHfn+Fj1noZuLsI9BlL3v0fuOwLzQh7mBAi/wQ+P3GdkaTiBtO/+JrQasKhr+xgJlDn/gQHoFUq+Eb9JErQXod9EBrxIzay5DqAtRdwM7am+haIJMjsB98OFc+w==',key_name='tempest-keypair-987998290',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-iccfxfxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=cc8aece0-15d7-4e9d-994a-3a2592246f8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "f7593a45-a32e-4150-ae32-f85caf5643c4", "address": "fa:16:3e:24:43:e2", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7593a45-a3", "ovs_interfaceid": "f7593a45-a32e-4150-ae32-f85caf5643c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG os_vif [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7593a45-a3, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:49 user nova-compute[72405]: INFO os_vif [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:43:e2,bridge_name='br-int',has_traffic_filtering=True,id=f7593a45-a32e-4150-ae32-f85caf5643c4,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7593a45-a3')
Aug 08 23:32:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Deleting instance files /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a_del
Aug 08 23:32:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Deletion of /opt/stack/data/nova/instances/cc8aece0-15d7-4e9d-994a-3a2592246f8a_del complete
Aug 08 23:32:49 user nova-compute[72405]: INFO nova.compute.manager [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 08 23:32:49 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:32:49 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:32:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6cf047c-c1c4-45c2-a4f3-cf8ac407c555 req-67d6e8c0-45e2-4e29-869d-6c0f4385534e service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6cf047c-c1c4-45c2-a4f3-cf8ac407c555 req-67d6e8c0-45e2-4e29-869d-6c0f4385534e service nova] Acquiring lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6cf047c-c1c4-45c2-a4f3-cf8ac407c555 req-67d6e8c0-45e2-4e29-869d-6c0f4385534e service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6cf047c-c1c4-45c2-a4f3-cf8ac407c555 req-67d6e8c0-45e2-4e29-869d-6c0f4385534e service nova] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6cf047c-c1c4-45c2-a4f3-cf8ac407c555 req-67d6e8c0-45e2-4e29-869d-6c0f4385534e service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] No waiting events found dispatching network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:50 user nova-compute[72405]: WARNING nova.compute.manager [req-e6cf047c-c1c4-45c2-a4f3-cf8ac407c555 req-67d6e8c0-45e2-4e29-869d-6c0f4385534e service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received unexpected event network-vif-plugged-f7593a45-a32e-4150-ae32-f85caf5643c4 for instance with vm_state active and task_state deleting.
Aug 08 23:32:51 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:51 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Took 1.65 seconds to deallocate network for instance.
Aug 08 23:32:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-8912ea32-9b29-4bfc-8930-12826fc27a85 req-99b1150c-e584-4768-8f9c-722654f706db service nova] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Received event network-vif-deleted-f7593a45-a32e-4150-ae32-f85caf5643c4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:51 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537556.4731193, 466645d2-64fb-4c97-899a-1997a0ef4bca => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:51 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] VM Stopped (Lifecycle Event)
Aug 08 23:32:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-71cf6e37-96a8-4790-81b3-ce51a251a9c3 None None] [instance: 466645d2-64fb-4c97-899a-1997a0ef4bca] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:51 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Deleted allocations for instance cc8aece0-15d7-4e9d-994a-3a2592246f8a
Aug 08 23:32:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5f4780dd-881d-4e67-92a3-6ae3b8af6c43 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "cc8aece0-15d7-4e9d-994a-3a2592246f8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.413s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:32:52 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Creating image(s)
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk 1073741824" returned: 0 in 0.060s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Cannot resize image /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Ensure instance console log exists: /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Start _get_guest_xml network_info=[{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5771273e-c448-451a-ba85-c67962cc778c', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5fc6348-e237-4f86-8179-c5dc34b9e1d2', 'attached_at': '', 'detached_at': '', 'volume_id': '0f3fca48-1880-4f2c-9873-528ae41fdcc0', 'serial': '0f3fca48-1880-4f2c-9873-528ae41fdcc0'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:32:52 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 08 23:32:52 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:32:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:32:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 08 23:32:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:32:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:32:52 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:32:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b36f675-5ef3-4327-91ae-556dc55836a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:32:53 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e5dff-d125-4e1f-be49-db29e2f3d008]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0] added
Aug 08 23:32:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[06348af9-120b-495f-b0d2-4bf6e3613db4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed0835-10ad-46b6-a347-9b4560750ba0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPzGmMkB {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPzGmMkB" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f6294-b2a6-41b6-a7d4-20b1c07db031]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qPzGmMkB'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9376e6-d086-49f1-b56c-cc19dfbe7b6f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf0e8e0-0a70-4fb0-9946-8d35a7c356e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed90b7-6d4d-4218-86ad-894f55b00991]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]
Aug 08 23:32:53 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.
Aug 08 23:32:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd6b53-b84a-4331-b716-db40abef897a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7bd14-f759-4b89-865f-9571764212b0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:32:53 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:32:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.690s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdfe3bc-b82b-4f58-b0f6-57c21080ee8b]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:53 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537558.9896226, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:53 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] VM Stopped (Lifecycle Event)
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-eb8b5999-3240-4506-835a-dbf602d014d3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.737s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== connect_volume: return (1739ms) {'type': 'block', 'scsi_wwn': '23161633137393634', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161633137393634', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525172976',display_name='tempest-ServerActionsTestOtherA-server-55724933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525172976',id=21,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-eqwjzdat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=e5fc6348-e237-4f86-8179-c5dc34b9e1d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:32:54 user nova-compute[72405]:   <uuid>e5fc6348-e237-4f86-8179-c5dc34b9e1d2</uuid>
Aug 08 23:32:54 user nova-compute[72405]:   <name>instance-00000015</name>
Aug 08 23:32:54 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:32:54 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:32:54 user nova-compute[72405]:   <metadata>
Aug 08 23:32:54 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:32:54 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:32:54 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherA-server-55724933</nova:name>
Aug 08 23:32:54 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:32:52</nova:creationTime>
Aug 08 23:32:54 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:32:54 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:32:54 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:32:54 user nova-compute[72405]:       <nova:owner>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:user uuid="f2e4ec54172a455187e10b1b119c8cec">tempest-ServerActionsTestOtherA-1743133349-project-member</nova:user>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:project uuid="628adffbe7ca403b8dc9c26f8254cddb">tempest-ServerActionsTestOtherA-1743133349</nova:project>
Aug 08 23:32:54 user nova-compute[72405]:       </nova:owner>
Aug 08 23:32:54 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:32:54 user nova-compute[72405]:       <nova:ports>
Aug 08 23:32:54 user nova-compute[72405]:         <nova:port uuid="eac5523e-985c-4a32-b6a6-b75f08a00cf9">
Aug 08 23:32:54 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:32:54 user nova-compute[72405]:         </nova:port>
Aug 08 23:32:54 user nova-compute[72405]:       </nova:ports>
Aug 08 23:32:54 user nova-compute[72405]:     </nova:instance>
Aug 08 23:32:54 user nova-compute[72405]:   </metadata>
Aug 08 23:32:54 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:32:54 user nova-compute[72405]:     <system>
Aug 08 23:32:54 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:32:54 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:32:54 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:32:54 user nova-compute[72405]:       <entry name="serial">e5fc6348-e237-4f86-8179-c5dc34b9e1d2</entry>
Aug 08 23:32:54 user nova-compute[72405]:       <entry name="uuid">e5fc6348-e237-4f86-8179-c5dc34b9e1d2</entry>
Aug 08 23:32:54 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:32:54 user nova-compute[72405]:     </system>
Aug 08 23:32:54 user nova-compute[72405]:   </sysinfo>
Aug 08 23:32:54 user nova-compute[72405]:   <os>
Aug 08 23:32:54 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:32:54 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:32:54 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:32:54 user nova-compute[72405]:   </os>
Aug 08 23:32:54 user nova-compute[72405]:   <features>
Aug 08 23:32:54 user nova-compute[72405]:     <acpi/>
Aug 08 23:32:54 user nova-compute[72405]:     <apic/>
Aug 08 23:32:54 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:32:54 user nova-compute[72405]:   </features>
Aug 08 23:32:54 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:32:54 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:32:54 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:32:54 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:32:54 user nova-compute[72405]:   </clock>
Aug 08 23:32:54 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:32:54 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:32:54 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:32:54 user nova-compute[72405]:   </cpu>
Aug 08 23:32:54 user nova-compute[72405]:   <devices>
Aug 08 23:32:54 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:32:54 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:32:54 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk"/>
Aug 08 23:32:54 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:32:54 user nova-compute[72405]:     </disk>
Aug 08 23:32:54 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:32:54 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:32:54 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:32:54 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:32:54 user nova-compute[72405]:       <serial>0f3fca48-1880-4f2c-9873-528ae41fdcc0</serial>
Aug 08 23:32:54 user nova-compute[72405]:     </disk>
Aug 08 23:32:54 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:32:54 user nova-compute[72405]:       <mac address="fa:16:3e:0c:91:38"/>
Aug 08 23:32:54 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:54 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:32:54 user nova-compute[72405]:       <target dev="tapeac5523e-98"/>
Aug 08 23:32:54 user nova-compute[72405]:     </interface>
Aug 08 23:32:54 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:32:54 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/console.log" append="off"/>
Aug 08 23:32:54 user nova-compute[72405]:     </serial>
Aug 08 23:32:54 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:32:54 user nova-compute[72405]:     <video>
Aug 08 23:32:54 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:54 user nova-compute[72405]:     </video>
Aug 08 23:32:54 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:32:54 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:32:54 user nova-compute[72405]:     </rng>
Aug 08 23:32:54 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:32:54 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:32:54 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:32:54 user nova-compute[72405]:     </memballoon>
Aug 08 23:32:54 user nova-compute[72405]:   </devices>
Aug 08 23:32:54 user nova-compute[72405]: </domain>
Aug 08 23:32:54 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525172976',display_name='tempest-ServerActionsTestOtherA-server-55724933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525172976',id=21,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:28:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-eqwjzdat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=e5fc6348-e237-4f86-8179-c5dc34b9e1d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG os_vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac5523e-98, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeac5523e-98, col_values=(('external_ids', {'iface-id': 'eac5523e-985c-4a32-b6a6-b75f08a00cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:91:38', 'vm-uuid': 'e5fc6348-e237-4f86-8179-c5dc34b9e1d2'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:54 user nova-compute[72405]: INFO os_vif [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98')
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No VIF found with MAC fa:16:3e:0c:91:38, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:54 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:32:54 user nova-compute[72405]: INFO nova.compute.claims [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Claim successful on node user
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:32:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.policy [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '518b2ba023554beb98d6fe6ac9f9fa87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247ab614640c4941ac18150695f535c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:32:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Creating image(s)
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "/opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "/opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk 1073741824" returned: 0 in 0.052s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Successfully created port: 55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Cannot resize image /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'migration_context' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Ensure instance console log exists: /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-8890cb72-3857-44f5-a0b4-4b76238ee5de req-939d5f27-7d61-497d-b4ed-240d776794a8 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8890cb72-3857-44f5-a0b4-4b76238ee5de req-939d5f27-7d61-497d-b4ed-240d776794a8 service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8890cb72-3857-44f5-a0b4-4b76238ee5de req-939d5f27-7d61-497d-b4ed-240d776794a8 service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8890cb72-3857-44f5-a0b4-4b76238ee5de req-939d5f27-7d61-497d-b4ed-240d776794a8 service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-8890cb72-3857-44f5-a0b4-4b76238ee5de req-939d5f27-7d61-497d-b4ed-240d776794a8 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:56 user nova-compute[72405]: WARNING nova.compute.manager [req-8890cb72-3857-44f5-a0b4-4b76238ee5de req-939d5f27-7d61-497d-b4ed-240d776794a8 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state active and task_state rebuild_spawning.
Aug 08 23:32:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Successfully updated port: 55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquired lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-changed-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Refreshing instance network info cache due to event network-changed-55e18cda-9a1e-47ed-b626-df5ad144df78. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] Acquiring lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updating instance_info_cache with network_info: [{"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Releasing lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Instance network_info: |[{"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] Acquired lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.neutron [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Refreshing network info cache for port 55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Start _get_guest_xml network_info=[{"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:32:57 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:57 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-88786235',display_name='tempest-TestServerVolumeAttachmentScenario-server-88786235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-88786235',id=27,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC984br+kwAxLBLJxH4ADW4uOcVNqydO6uEoFrOXjeF81yn02ir9SE1If5dDMvMqhTu986QQBryr9KpM80+gDyJjlSsDHGmvGyH9XJQFUI7SYlCSGcTESQQUM7czZtkf8Q==',key_name='tempest-keypair-33664245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='247ab614640c4941ac18150695f535c3',ramdisk_id='',reservation_id='r-x75w9u0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2103023061',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2103023061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518b2ba023554beb98d6fe6ac9f9fa87',uuid=ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Converting VIF {"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'pci_devices' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:32:57 user nova-compute[72405]:   <uuid>ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf</uuid>
Aug 08 23:32:57 user nova-compute[72405]:   <name>instance-0000001b</name>
Aug 08 23:32:57 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:32:57 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:32:57 user nova-compute[72405]:   <metadata>
Aug 08 23:32:57 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:32:57 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:32:57 user nova-compute[72405]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-88786235</nova:name>
Aug 08 23:32:57 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:32:57</nova:creationTime>
Aug 08 23:32:57 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:32:57 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:32:57 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:32:57 user nova-compute[72405]:       <nova:owner>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:user uuid="518b2ba023554beb98d6fe6ac9f9fa87">tempest-TestServerVolumeAttachmentScenario-2103023061-project-member</nova:user>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:project uuid="247ab614640c4941ac18150695f535c3">tempest-TestServerVolumeAttachmentScenario-2103023061</nova:project>
Aug 08 23:32:57 user nova-compute[72405]:       </nova:owner>
Aug 08 23:32:57 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:32:57 user nova-compute[72405]:       <nova:ports>
Aug 08 23:32:57 user nova-compute[72405]:         <nova:port uuid="55e18cda-9a1e-47ed-b626-df5ad144df78">
Aug 08 23:32:57 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:32:57 user nova-compute[72405]:         </nova:port>
Aug 08 23:32:57 user nova-compute[72405]:       </nova:ports>
Aug 08 23:32:57 user nova-compute[72405]:     </nova:instance>
Aug 08 23:32:57 user nova-compute[72405]:   </metadata>
Aug 08 23:32:57 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:32:57 user nova-compute[72405]:     <system>
Aug 08 23:32:57 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:32:57 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:32:57 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:32:57 user nova-compute[72405]:       <entry name="serial">ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf</entry>
Aug 08 23:32:57 user nova-compute[72405]:       <entry name="uuid">ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf</entry>
Aug 08 23:32:57 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:32:57 user nova-compute[72405]:     </system>
Aug 08 23:32:57 user nova-compute[72405]:   </sysinfo>
Aug 08 23:32:57 user nova-compute[72405]:   <os>
Aug 08 23:32:57 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:32:57 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:32:57 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:32:57 user nova-compute[72405]:   </os>
Aug 08 23:32:57 user nova-compute[72405]:   <features>
Aug 08 23:32:57 user nova-compute[72405]:     <acpi/>
Aug 08 23:32:57 user nova-compute[72405]:     <apic/>
Aug 08 23:32:57 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:32:57 user nova-compute[72405]:   </features>
Aug 08 23:32:57 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:32:57 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:32:57 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:32:57 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:32:57 user nova-compute[72405]:   </clock>
Aug 08 23:32:57 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:32:57 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:32:57 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:32:57 user nova-compute[72405]:   </cpu>
Aug 08 23:32:57 user nova-compute[72405]:   <devices>
Aug 08 23:32:57 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:32:57 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:32:57 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk"/>
Aug 08 23:32:57 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:32:57 user nova-compute[72405]:     </disk>
Aug 08 23:32:57 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:32:57 user nova-compute[72405]:       <mac address="fa:16:3e:e5:c7:7e"/>
Aug 08 23:32:57 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:57 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:32:57 user nova-compute[72405]:       <target dev="tap55e18cda-9a"/>
Aug 08 23:32:57 user nova-compute[72405]:     </interface>
Aug 08 23:32:57 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:32:57 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/console.log" append="off"/>
Aug 08 23:32:57 user nova-compute[72405]:     </serial>
Aug 08 23:32:57 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:32:57 user nova-compute[72405]:     <video>
Aug 08 23:32:57 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:32:57 user nova-compute[72405]:     </video>
Aug 08 23:32:57 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:32:57 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:32:57 user nova-compute[72405]:     </rng>
Aug 08 23:32:57 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:32:57 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:32:57 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:32:57 user nova-compute[72405]:     </memballoon>
Aug 08 23:32:57 user nova-compute[72405]:   </devices>
Aug 08 23:32:57 user nova-compute[72405]: </domain>
Aug 08 23:32:57 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-88786235',display_name='tempest-TestServerVolumeAttachmentScenario-server-88786235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-88786235',id=27,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC984br+kwAxLBLJxH4ADW4uOcVNqydO6uEoFrOXjeF81yn02ir9SE1If5dDMvMqhTu986QQBryr9KpM80+gDyJjlSsDHGmvGyH9XJQFUI7SYlCSGcTESQQUM7czZtkf8Q==',key_name='tempest-keypair-33664245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='247ab614640c4941ac18150695f535c3',ramdisk_id='',reservation_id='r-x75w9u0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2103023061',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2103023061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518b2ba023554beb98d6fe6ac9f9fa87',uuid=ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Converting VIF {"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG os_vif [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55e18cda-9a, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55e18cda-9a, col_values=(('external_ids', {'iface-id': '55e18cda-9a1e-47ed-b626-df5ad144df78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:c7:7e', 'vm-uuid': 'ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:58 user nova-compute[72405]: INFO os_vif [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a')
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No VIF found with MAC fa:16:3e:e5:c7:7e, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537578.2439015, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:58 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] VM Resumed (Lifecycle Event)
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:58 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance spawned successfully.
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:32:58 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537578.2441201, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:32:58 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] VM Started (Lifecycle Event)
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updated VIF entry in instance network info cache for port 55e18cda-9a1e-47ed-b626-df5ad144df78. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updating instance_info_cache with network_info: [{"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a79ff38c-6076-4f1b-934b-f484a331ff47 req-c753c618-be53-4f0e-9232-21fc5e2f97dd service nova] Releasing lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:32:58 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-c94502f6-d851-445e-a2cd-b0b2f6f60a69 req-7e259ff3-9c35-43f8-ab0c-c3d8755788ce service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c94502f6-d851-445e-a2cd-b0b2f6f60a69 req-7e259ff3-9c35-43f8-ab0c-c3d8755788ce service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c94502f6-d851-445e-a2cd-b0b2f6f60a69 req-7e259ff3-9c35-43f8-ab0c-c3d8755788ce service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c94502f6-d851-445e-a2cd-b0b2f6f60a69 req-7e259ff3-9c35-43f8-ab0c-c3d8755788ce service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-c94502f6-d851-445e-a2cd-b0b2f6f60a69 req-7e259ff3-9c35-43f8-ab0c-c3d8755788ce service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:58 user nova-compute[72405]: WARNING nova.compute.manager [req-c94502f6-d851-445e-a2cd-b0b2f6f60a69 req-7e259ff3-9c35-43f8-ab0c-c3d8755788ce service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state active and task_state rebuild_spawning.
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72405) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38214a3a-e0ec-4b61-8f97-30863406f5f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-87a7016a-95a2-4fa6-b971-c923c9787511 req-8de95212-15e0-4c29-8677-28acefdccc54 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87a7016a-95a2-4fa6-b971-c923c9787511 req-8de95212-15e0-4c29-8677-28acefdccc54 service nova] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87a7016a-95a2-4fa6-b971-c923c9787511 req-8de95212-15e0-4c29-8677-28acefdccc54 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-87a7016a-95a2-4fa6-b971-c923c9787511 req-8de95212-15e0-4c29-8677-28acefdccc54 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:32:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-87a7016a-95a2-4fa6-b971-c923c9787511 req-8de95212-15e0-4c29-8677-28acefdccc54 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] No waiting events found dispatching network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:32:59 user nova-compute[72405]: WARNING nova.compute.manager [req-87a7016a-95a2-4fa6-b971-c923c9787511 req-8de95212-15e0-4c29-8677-28acefdccc54 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received unexpected event network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 for instance with vm_state building and task_state spawning.
Aug 08 23:32:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537581.689423, ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] VM Resumed (Lifecycle Event)
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Instance spawned successfully.
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-1599fac1-9580-4249-8667-c4cedba547f2 req-f6c5460a-9f48-4987-bf28-e2efd933f328 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1599fac1-9580-4249-8667-c4cedba547f2 req-f6c5460a-9f48-4987-bf28-e2efd933f328 service nova] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1599fac1-9580-4249-8667-c4cedba547f2 req-f6c5460a-9f48-4987-bf28-e2efd933f328 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1599fac1-9580-4249-8667-c4cedba547f2 req-f6c5460a-9f48-4987-bf28-e2efd933f328 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-1599fac1-9580-4249-8667-c4cedba547f2 req-f6c5460a-9f48-4987-bf28-e2efd933f328 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] No waiting events found dispatching network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:01 user nova-compute[72405]: WARNING nova.compute.manager [req-1599fac1-9580-4249-8667-c4cedba547f2 req-f6c5460a-9f48-4987-bf28-e2efd933f328 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received unexpected event network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 for instance with vm_state building and task_state spawning.
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537581.6941376, ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] VM Started (Lifecycle Event)
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 08 23:33:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:01 user nova-compute[72405]: INFO nova.compute.manager [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Took 6.94 seconds to build instance.
Aug 08 23:33:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fb13dd0b-1e7b-49dd-8ee8-c838dc24e45b tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.035s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:04 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537569.320086, cc8aece0-15d7-4e9d-994a-3a2592246f8a => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:04 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] VM Stopped (Lifecycle Event)
Aug 08 23:33:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-58ed23fd-9b3b-4019-8459-1ac6e25bf37c None None] [instance: cc8aece0-15d7-4e9d-994a-3a2592246f8a] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:05 user nova-compute[72405]: INFO nova.compute.manager [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] instance snapshotting
Aug 08 23:33:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Beginning live snapshot process
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb1t88ody/35e2951a3cf741da835f6768372c7e8e.delta 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb1t88ody/35e2951a3cf741da835f6768372c7e8e.delta 1073741824" returned: 0 in 0.049s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 08 23:33:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:33:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] COPY block job progress, current cursor: 48693248 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:33:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 08 23:33:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 08 23:33:07 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:33:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb1t88ody/35e2951a3cf741da835f6768372c7e8e.delta /opt/stack/data/nova/instances/snapshots/tmpb1t88ody/35e2951a3cf741da835f6768372c7e8e {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb1t88ody/35e2951a3cf741da835f6768372c7e8e.delta /opt/stack/data/nova/instances/snapshots/tmpb1t88ody/35e2951a3cf741da835f6768372c7e8e" returned: 0 in 0.542s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Snapshot extracted, beginning image upload
Aug 08 23:33:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Snapshot image upload complete
Aug 08 23:33:10 user nova-compute[72405]: INFO nova.compute.manager [None req-0041339c-8c11-4a7d-90ca-edbd4f856df4 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Took 5.36 seconds to snapshot the instance on the hypervisor.
Aug 08 23:33:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:33:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:33:14 user nova-compute[72405]: INFO nova.compute.claims [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Claim successful on node user
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:33:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.policy [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e934b55e46634b7097bb144b74ac5954', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ebca86ade54e1f9805255b64901be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:33:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Creating image(s)
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "/opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "/opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk 1073741824" returned: 0 in 0.051s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Cannot resize image /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'migration_context' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Successfully created port: 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Ensure instance console log exists: /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Successfully updated port: 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquired lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-changed-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Refreshing instance network info cache due to event network-changed-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] Acquiring lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating instance_info_cache with network_info: [{"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Releasing lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Instance network_info: |[{"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] Acquired lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Refreshing network info cache for port 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Start _get_guest_xml network_info=[{"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:33:16 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:16 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2114968723',display_name='tempest-AttachVolumeTestJSON-server-2114968723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2114968723',id=28,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJECbKEi7avTHBNfy+W9Zi6McF3LliK2DC0FMZd7ItKFh5psdYpoa9e48NzgPjesraSct7hmxF7n9zopCOJIJccxcvVgVgeFqgOaaV4UwAdRkePK0r41ZDGQrz9jadSzg==',key_name='tempest-keypair-215023531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-lsptg72e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=1aa97616-8607-4e4b-9264-fc3946be06ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:33:16 user nova-compute[72405]:   <uuid>1aa97616-8607-4e4b-9264-fc3946be06ba</uuid>
Aug 08 23:33:16 user nova-compute[72405]:   <name>instance-0000001c</name>
Aug 08 23:33:16 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:33:16 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:33:16 user nova-compute[72405]:   <metadata>
Aug 08 23:33:16 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:33:16 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:33:16 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeTestJSON-server-2114968723</nova:name>
Aug 08 23:33:16 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:33:16</nova:creationTime>
Aug 08 23:33:16 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:33:16 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:33:16 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:33:16 user nova-compute[72405]:       <nova:owner>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:user uuid="e934b55e46634b7097bb144b74ac5954">tempest-AttachVolumeTestJSON-1838616528-project-member</nova:user>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:project uuid="72ebca86ade54e1f9805255b64901be8">tempest-AttachVolumeTestJSON-1838616528</nova:project>
Aug 08 23:33:16 user nova-compute[72405]:       </nova:owner>
Aug 08 23:33:16 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:33:16 user nova-compute[72405]:       <nova:ports>
Aug 08 23:33:16 user nova-compute[72405]:         <nova:port uuid="0a7af3ac-cb0a-4e50-a04d-2c84a92371b6">
Aug 08 23:33:16 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 08 23:33:16 user nova-compute[72405]:         </nova:port>
Aug 08 23:33:16 user nova-compute[72405]:       </nova:ports>
Aug 08 23:33:16 user nova-compute[72405]:     </nova:instance>
Aug 08 23:33:16 user nova-compute[72405]:   </metadata>
Aug 08 23:33:16 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:33:16 user nova-compute[72405]:     <system>
Aug 08 23:33:16 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:33:16 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:33:16 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:33:16 user nova-compute[72405]:       <entry name="serial">1aa97616-8607-4e4b-9264-fc3946be06ba</entry>
Aug 08 23:33:16 user nova-compute[72405]:       <entry name="uuid">1aa97616-8607-4e4b-9264-fc3946be06ba</entry>
Aug 08 23:33:16 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:33:16 user nova-compute[72405]:     </system>
Aug 08 23:33:16 user nova-compute[72405]:   </sysinfo>
Aug 08 23:33:16 user nova-compute[72405]:   <os>
Aug 08 23:33:16 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:33:16 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:33:16 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:33:16 user nova-compute[72405]:   </os>
Aug 08 23:33:16 user nova-compute[72405]:   <features>
Aug 08 23:33:16 user nova-compute[72405]:     <acpi/>
Aug 08 23:33:16 user nova-compute[72405]:     <apic/>
Aug 08 23:33:16 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:33:16 user nova-compute[72405]:   </features>
Aug 08 23:33:16 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:33:16 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:33:16 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:33:16 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:33:16 user nova-compute[72405]:   </clock>
Aug 08 23:33:16 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:33:16 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:33:16 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:33:16 user nova-compute[72405]:   </cpu>
Aug 08 23:33:16 user nova-compute[72405]:   <devices>
Aug 08 23:33:16 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:33:16 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:33:16 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk"/>
Aug 08 23:33:16 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:33:16 user nova-compute[72405]:     </disk>
Aug 08 23:33:16 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:33:16 user nova-compute[72405]:       <mac address="fa:16:3e:40:25:52"/>
Aug 08 23:33:16 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:33:16 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:33:16 user nova-compute[72405]:       <target dev="tap0a7af3ac-cb"/>
Aug 08 23:33:16 user nova-compute[72405]:     </interface>
Aug 08 23:33:16 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:33:16 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/console.log" append="off"/>
Aug 08 23:33:16 user nova-compute[72405]:     </serial>
Aug 08 23:33:16 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:33:16 user nova-compute[72405]:     <video>
Aug 08 23:33:16 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:33:16 user nova-compute[72405]:     </video>
Aug 08 23:33:16 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:33:16 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:33:16 user nova-compute[72405]:     </rng>
Aug 08 23:33:16 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:33:16 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:33:16 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:33:16 user nova-compute[72405]:     </memballoon>
Aug 08 23:33:16 user nova-compute[72405]:   </devices>
Aug 08 23:33:16 user nova-compute[72405]: </domain>
Aug 08 23:33:16 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2114968723',display_name='tempest-AttachVolumeTestJSON-server-2114968723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2114968723',id=28,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJECbKEi7avTHBNfy+W9Zi6McF3LliK2DC0FMZd7ItKFh5psdYpoa9e48NzgPjesraSct7hmxF7n9zopCOJIJccxcvVgVgeFqgOaaV4UwAdRkePK0r41ZDGQrz9jadSzg==',key_name='tempest-keypair-215023531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-lsptg72e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=1aa97616-8607-4e4b-9264-fc3946be06ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG os_vif [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a7af3ac-cb, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a7af3ac-cb, col_values=(('external_ids', {'iface-id': '0a7af3ac-cb0a-4e50-a04d-2c84a92371b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:25:52', 'vm-uuid': '1aa97616-8607-4e4b-9264-fc3946be06ba'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:16 user nova-compute[72405]: INFO os_vif [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb')
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:33:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No VIF found with MAC fa:16:3e:40:25:52, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:33:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updated VIF entry in instance network info cache for port 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:33:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating instance_info_cache with network_info: [{"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cbcc24b8-69dc-44ac-b10e-caa8361c5440 req-9b6d7c92-1688-4db2-b7bd-82df3d22e0f7 service nova] Releasing lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-166c0ba2-b999-4d7a-948d-147e4550053c req-a0336ba0-427d-48d6-9988-ac87a4ee1f23 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-166c0ba2-b999-4d7a-948d-147e4550053c req-a0336ba0-427d-48d6-9988-ac87a4ee1f23 service nova] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-166c0ba2-b999-4d7a-948d-147e4550053c req-a0336ba0-427d-48d6-9988-ac87a4ee1f23 service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-166c0ba2-b999-4d7a-948d-147e4550053c req-a0336ba0-427d-48d6-9988-ac87a4ee1f23 service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-166c0ba2-b999-4d7a-948d-147e4550053c req-a0336ba0-427d-48d6-9988-ac87a4ee1f23 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] No waiting events found dispatching network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:18 user nova-compute[72405]: WARNING nova.compute.manager [req-166c0ba2-b999-4d7a-948d-147e4550053c req-a0336ba0-427d-48d6-9988-ac87a4ee1f23 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received unexpected event network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 for instance with vm_state building and task_state spawning.
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-5e92ed64-d144-435a-8943-c91ac40f64b6 req-9804ff59-624f-4a8a-8cdd-5c52a5677065 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e92ed64-d144-435a-8943-c91ac40f64b6 req-9804ff59-624f-4a8a-8cdd-5c52a5677065 service nova] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e92ed64-d144-435a-8943-c91ac40f64b6 req-9804ff59-624f-4a8a-8cdd-5c52a5677065 service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5e92ed64-d144-435a-8943-c91ac40f64b6 req-9804ff59-624f-4a8a-8cdd-5c52a5677065 service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-5e92ed64-d144-435a-8943-c91ac40f64b6 req-9804ff59-624f-4a8a-8cdd-5c52a5677065 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] No waiting events found dispatching network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:20 user nova-compute[72405]: WARNING nova.compute.manager [req-5e92ed64-d144-435a-8943-c91ac40f64b6 req-9804ff59-624f-4a8a-8cdd-5c52a5677065 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received unexpected event network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 for instance with vm_state building and task_state spawning.
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537600.6013072, 1aa97616-8607-4e4b-9264-fc3946be06ba => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] VM Resumed (Lifecycle Event)
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Instance spawned successfully.
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537600.6029742, 1aa97616-8607-4e4b-9264-fc3946be06ba => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] VM Started (Lifecycle Event)
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 08 23:33:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:20 user nova-compute[72405]: INFO nova.compute.manager [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Took 6.78 seconds to build instance.
Aug 08 23:33:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf9f062-7a5c-4988-9901-17a877956069 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.910s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing instance network info cache due to event network-changed-1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] Acquiring lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] Acquired lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Refreshing network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:29 user nova-compute[72405]: INFO nova.compute.manager [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Terminating instance
Aug 08 23:33:29 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-59c5caa1-7d3b-4d79-928b-ad0aaa80996f req-59c3e2a7-d4e3-4ad3-a597-1909c0f2c0e5 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-unplugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-59c5caa1-7d3b-4d79-928b-ad0aaa80996f req-59c3e2a7-d4e3-4ad3-a597-1909c0f2c0e5 service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-59c5caa1-7d3b-4d79-928b-ad0aaa80996f req-59c3e2a7-d4e3-4ad3-a597-1909c0f2c0e5 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-59c5caa1-7d3b-4d79-928b-ad0aaa80996f req-59c3e2a7-d4e3-4ad3-a597-1909c0f2c0e5 service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-59c5caa1-7d3b-4d79-928b-ad0aaa80996f req-59c3e2a7-d4e3-4ad3-a597-1909c0f2c0e5 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-unplugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-59c5caa1-7d3b-4d79-928b-ad0aaa80996f req-59c3e2a7-d4e3-4ad3-a597-1909c0f2c0e5 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-unplugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updated VIF entry in instance network info cache for port 1bc5f924-bce3-4575-b361-f65e36f62b88. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [{"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-94646850-e2dd-4169-870c-bbbf9abd9e26 req-19fc9c51-0d5b-4792-8ef7-bc17b72334d0 service nova] Releasing lock "refresh_cache-30ae278e-aa85-4896-84a1-a5301f5c5ccd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Instance destroyed successfully.
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lazy-loading 'resources' on Instance uuid 30ae278e-aa85-4896-84a1-a5301f5c5ccd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1879559594',display_name='tempest-TestShelveInstance-server-1879559594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1879559594',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMQPbmgGwiwmfcSvnP4zk8kB/DIa6fkpGy/NXzZIly5roH+tc7tcLgZFTKtcUNuntPXCRUUJ+w5Mz4sfHrTkcoyXwF37gSP0OmzMumpwGfmFJbaJhlfCRbBueeZSay3eg==',key_name='tempest-TestShelveInstance-350639281',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d232f86412044a58663caf23a71cc3b',ramdisk_id='',reservation_id='r-wt4dngfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1642333906',owner_user_name='tempest-TestShelveInstance-1642333906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:32:05Z,user_data=None,user_id='3e3c4d0e349b49f0ac2151b1bcb1af87',uuid=30ae278e-aa85-4896-84a1-a5301f5c5ccd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converting VIF {"id": "1bc5f924-bce3-4575-b361-f65e36f62b88", "address": "fa:16:3e:7d:1c:56", "network": {"id": "5d7f112a-e13a-4968-bac1-e631bcbb67a2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1935227541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d232f86412044a58663caf23a71cc3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5f924-bc", "ovs_interfaceid": "1bc5f924-bce3-4575-b361-f65e36f62b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_vif [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bc5f924-bc, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:33:30 user nova-compute[72405]: INFO os_vif [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=1bc5f924-bce3-4575-b361-f65e36f62b88,network=Network(5d7f112a-e13a-4968-bac1-e631bcbb67a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5f924-bc')
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzcsBhyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:33:30 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee750dd-f6aa-4d99-bb33-a2d1f97fb8f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84634a-7c30-412a-91f9-b7f064bbdd95]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:33:30 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:33:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f2e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff7cd7-1723-469f-a9a8-952bff606bb6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5f104c-37a9-44ae-affa-56289719cda9]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7562b408-2bde-428e-b9c2-c72b9bd7f505]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b4303e-b8e5-4f99-8f09-e5b9a0a5a853]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020190c-c934-4b10-8721-b9104d64595c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ef80a-966d-413a-a394-0088f3647779]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260]
Aug 08 23:33:30 user nova-compute[72405]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834, portal: 172.16.0.220,3260] successful.
Aug 08 23:33:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf353614-3578-4b1c-a636-15a160b4a834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b710e1-c3ac-4790-8d9a-a42eb6c91d00]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] <== disconnect_volume: return (296ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:33:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:33:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Deleting instance files /opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd_del
Aug 08 23:33:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Deletion of /opt/stack/data/nova/instances/30ae278e-aa85-4896-84a1-a5301f5c5ccd_del complete
Aug 08 23:33:31 user nova-compute[72405]: INFO nova.compute.manager [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 08 23:33:31 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:33:31 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:33:31 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:33:31 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:31 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Took 0.49 seconds to deallocate network for instance.
Aug 08 23:33:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-ab9afd5e-3a58-427f-bb2c-c69a6f2f21df req-38462c0c-d5ef-45b9-9559-f042b1f878fb service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-deleted-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa12a727-9685-44ce-9da4-0e88d55085e1 req-cd90cc9d-c2ea-48da-b6d3-40f84ed0468f service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa12a727-9685-44ce-9da4-0e88d55085e1 req-cd90cc9d-c2ea-48da-b6d3-40f84ed0468f service nova] Acquiring lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa12a727-9685-44ce-9da4-0e88d55085e1 req-cd90cc9d-c2ea-48da-b6d3-40f84ed0468f service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa12a727-9685-44ce-9da4-0e88d55085e1 req-cd90cc9d-c2ea-48da-b6d3-40f84ed0468f service nova] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa12a727-9685-44ce-9da4-0e88d55085e1 req-cd90cc9d-c2ea-48da-b6d3-40f84ed0468f service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] No waiting events found dispatching network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:32 user nova-compute[72405]: WARNING nova.compute.manager [req-fa12a727-9685-44ce-9da4-0e88d55085e1 req-cd90cc9d-c2ea-48da-b6d3-40f84ed0468f service nova] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Received unexpected event network-vif-plugged-1bc5f924-bce3-4575-b361-f65e36f62b88 for instance with vm_state active and task_state deleting.
Aug 08 23:33:32 user nova-compute[72405]: INFO nova.compute.manager [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Took 0.75 seconds to detach 1 volumes for instance.
Aug 08 23:33:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Deleting volume: bf353614-3578-4b1c-a636-15a160b4a834 {{(pid=72405) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:32 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Deleted allocations for instance 30ae278e-aa85-4896-84a1-a5301f5c5ccd
Aug 08 23:33:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f34ddbad-8bcf-4407-a364-66e28429aaf8 tempest-TestShelveInstance-1642333906 tempest-TestShelveInstance-1642333906-project-member] Lock "30ae278e-aa85-4896-84a1-a5301f5c5ccd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:33:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:33:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:34 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:33:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:34 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:33:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=25.102657318115234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Applying migration context for instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf as it has an incoming, in-progress migration 6af202c9-a8e7-43bf-affd-7985a25456c1. Migration status is finished {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 08 23:33:42 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating resource usage from migration 6af202c9-a8e7-43bf-affd-7985a25456c1
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Migration 6af202c9-a8e7-43bf-affd-7985a25456c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance befa7939-87a3-4258-9d44-dd986d9d5ea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 1aa97616-8607-4e4b-9264-fc3946be06ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8e0172ab-2223-492a-8dd5-985228661916 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.749s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.289s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:33:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:33:42 user nova-compute[72405]: INFO nova.compute.claims [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Claim successful on node user
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:33:43 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.policy [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8334edbf14ec382f6cd1c426703c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a146c9a0c224249ac3316e931874bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:33:43 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Creating image(s)
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "/opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk 1073741824" returned: 0 in 0.062s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Successfully created port: 66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Cannot resize image /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'migration_context' on Instance uuid 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Ensure instance console log exists: /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Successfully updated port: 66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquired lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-changed-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Refreshing instance network info cache due to event network-changed-66c4a5b9-cee6-4852-bb58-79c44f919792. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] Acquiring lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updating instance_info_cache with network_info: [{"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Releasing lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Instance network_info: |[{"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] Acquired lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Refreshing network info cache for port 66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Start _get_guest_xml network_info=[{"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:33:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-570121098',display_name='tempest-AttachVolumeNegativeTest-server-570121098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-570121098',id=29,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfQO4cFP1G0eJW8k9vdrR5FXt4N1kCg9uTRb9I0y/P1pEq7kbKfWCs0azGyRYghD5+DYbYqkb3LmPXmTNCytJ7hxrJ0sOeWYVzo5UGh54b2K3uSdlQ6STfc3Zv8+bQM0Q==',key_name='tempest-keypair-183601721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-4o9gkvmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=8e0172ab-2223-492a-8dd5-985228661916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:33:45 user nova-compute[72405]:   <uuid>8e0172ab-2223-492a-8dd5-985228661916</uuid>
Aug 08 23:33:45 user nova-compute[72405]:   <name>instance-0000001d</name>
Aug 08 23:33:45 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:33:45 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:33:45 user nova-compute[72405]:   <metadata>
Aug 08 23:33:45 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:33:45 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:33:45 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeNegativeTest-server-570121098</nova:name>
Aug 08 23:33:45 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:33:45</nova:creationTime>
Aug 08 23:33:45 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:33:45 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:33:45 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:33:45 user nova-compute[72405]:       <nova:owner>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:user uuid="5eb8334edbf14ec382f6cd1c426703c6">tempest-AttachVolumeNegativeTest-1663634564-project-member</nova:user>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:project uuid="4a146c9a0c224249ac3316e931874bc5">tempest-AttachVolumeNegativeTest-1663634564</nova:project>
Aug 08 23:33:45 user nova-compute[72405]:       </nova:owner>
Aug 08 23:33:45 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:33:45 user nova-compute[72405]:       <nova:ports>
Aug 08 23:33:45 user nova-compute[72405]:         <nova:port uuid="66c4a5b9-cee6-4852-bb58-79c44f919792">
Aug 08 23:33:45 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 08 23:33:45 user nova-compute[72405]:         </nova:port>
Aug 08 23:33:45 user nova-compute[72405]:       </nova:ports>
Aug 08 23:33:45 user nova-compute[72405]:     </nova:instance>
Aug 08 23:33:45 user nova-compute[72405]:   </metadata>
Aug 08 23:33:45 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:33:45 user nova-compute[72405]:     <system>
Aug 08 23:33:45 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:33:45 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:33:45 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:33:45 user nova-compute[72405]:       <entry name="serial">8e0172ab-2223-492a-8dd5-985228661916</entry>
Aug 08 23:33:45 user nova-compute[72405]:       <entry name="uuid">8e0172ab-2223-492a-8dd5-985228661916</entry>
Aug 08 23:33:45 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:33:45 user nova-compute[72405]:     </system>
Aug 08 23:33:45 user nova-compute[72405]:   </sysinfo>
Aug 08 23:33:45 user nova-compute[72405]:   <os>
Aug 08 23:33:45 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:33:45 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:33:45 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:33:45 user nova-compute[72405]:   </os>
Aug 08 23:33:45 user nova-compute[72405]:   <features>
Aug 08 23:33:45 user nova-compute[72405]:     <acpi/>
Aug 08 23:33:45 user nova-compute[72405]:     <apic/>
Aug 08 23:33:45 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:33:45 user nova-compute[72405]:   </features>
Aug 08 23:33:45 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:33:45 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:33:45 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:33:45 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:33:45 user nova-compute[72405]:   </clock>
Aug 08 23:33:45 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:33:45 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:33:45 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:33:45 user nova-compute[72405]:   </cpu>
Aug 08 23:33:45 user nova-compute[72405]:   <devices>
Aug 08 23:33:45 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:33:45 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:33:45 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk"/>
Aug 08 23:33:45 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:33:45 user nova-compute[72405]:     </disk>
Aug 08 23:33:45 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:33:45 user nova-compute[72405]:       <mac address="fa:16:3e:8a:d7:4e"/>
Aug 08 23:33:45 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:33:45 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:33:45 user nova-compute[72405]:       <target dev="tap66c4a5b9-ce"/>
Aug 08 23:33:45 user nova-compute[72405]:     </interface>
Aug 08 23:33:45 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:33:45 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/console.log" append="off"/>
Aug 08 23:33:45 user nova-compute[72405]:     </serial>
Aug 08 23:33:45 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:33:45 user nova-compute[72405]:     <video>
Aug 08 23:33:45 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:33:45 user nova-compute[72405]:     </video>
Aug 08 23:33:45 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:33:45 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:33:45 user nova-compute[72405]:     </rng>
Aug 08 23:33:45 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:33:45 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:33:45 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:33:45 user nova-compute[72405]:     </memballoon>
Aug 08 23:33:45 user nova-compute[72405]:   </devices>
Aug 08 23:33:45 user nova-compute[72405]: </domain>
Aug 08 23:33:45 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-570121098',display_name='tempest-AttachVolumeNegativeTest-server-570121098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-570121098',id=29,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfQO4cFP1G0eJW8k9vdrR5FXt4N1kCg9uTRb9I0y/P1pEq7kbKfWCs0azGyRYghD5+DYbYqkb3LmPXmTNCytJ7hxrJ0sOeWYVzo5UGh54b2K3uSdlQ6STfc3Zv8+bQM0Q==',key_name='tempest-keypair-183601721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-4o9gkvmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=8e0172ab-2223-492a-8dd5-985228661916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG os_vif [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66c4a5b9-ce, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66c4a5b9-ce, col_values=(('external_ids', {'iface-id': '66c4a5b9-cee6-4852-bb58-79c44f919792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:d7:4e', 'vm-uuid': '8e0172ab-2223-492a-8dd5-985228661916'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:45 user nova-compute[72405]: INFO os_vif [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce')
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537610.5947, 30ae278e-aa85-4896-84a1-a5301f5c5ccd => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:45 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] VM Stopped (Lifecycle Event)
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:8a:d7:4e, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ab47fd4f-d360-4a6c-92f3-94830224648e None None] [instance: 30ae278e-aa85-4896-84a1-a5301f5c5ccd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updated VIF entry in instance network info cache for port 66c4a5b9-cee6-4852-bb58-79c44f919792. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updating instance_info_cache with network_info: [{"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d8068bf0-274c-4f72-b9c8-f21f7d2f9d85 req-ca7c08c3-2bc6-408a-983a-690ba3caffd1 service nova] Releasing lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-4bc58c67-1178-44d7-a378-a5102b5716af req-b349bf55-bcbd-48e0-b270-b72a4862797d service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4bc58c67-1178-44d7-a378-a5102b5716af req-b349bf55-bcbd-48e0-b270-b72a4862797d service nova] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4bc58c67-1178-44d7-a378-a5102b5716af req-b349bf55-bcbd-48e0-b270-b72a4862797d service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4bc58c67-1178-44d7-a378-a5102b5716af req-b349bf55-bcbd-48e0-b270-b72a4862797d service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-4bc58c67-1178-44d7-a378-a5102b5716af req-b349bf55-bcbd-48e0-b270-b72a4862797d service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] No waiting events found dispatching network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:47 user nova-compute[72405]: WARNING nova.compute.manager [req-4bc58c67-1178-44d7-a378-a5102b5716af req-b349bf55-bcbd-48e0-b270-b72a4862797d service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received unexpected event network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 for instance with vm_state building and task_state spawning.
Aug 08 23:33:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537629.0526347, 8e0172ab-2223-492a-8dd5-985228661916 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] VM Resumed (Lifecycle Event)
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Instance spawned successfully.
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537629.0538518, 8e0172ab-2223-492a-8dd5-985228661916 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] VM Started (Lifecycle Event)
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-d1cfb2cf-84a5-4ef8-8c9b-9929f049c173 req-b3212e5c-b17c-4bf4-bb43-68c4419a472d service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d1cfb2cf-84a5-4ef8-8c9b-9929f049c173 req-b3212e5c-b17c-4bf4-bb43-68c4419a472d service nova] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d1cfb2cf-84a5-4ef8-8c9b-9929f049c173 req-b3212e5c-b17c-4bf4-bb43-68c4419a472d service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d1cfb2cf-84a5-4ef8-8c9b-9929f049c173 req-b3212e5c-b17c-4bf4-bb43-68c4419a472d service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-d1cfb2cf-84a5-4ef8-8c9b-9929f049c173 req-b3212e5c-b17c-4bf4-bb43-68c4419a472d service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] No waiting events found dispatching network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:49 user nova-compute[72405]: WARNING nova.compute.manager [req-d1cfb2cf-84a5-4ef8-8c9b-9929f049c173 req-b3212e5c-b17c-4bf4-bb43-68c4419a472d service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received unexpected event network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 for instance with vm_state building and task_state spawning.
Aug 08 23:33:49 user nova-compute[72405]: INFO nova.compute.manager [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Took 6.70 seconds to build instance.
Aug 08 23:33:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d93976fb-6188-4399-8c03-48e50dcd50c7 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.801s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:33:50 user nova-compute[72405]: INFO nova.compute.claims [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Claim successful on node user
Aug 08 23:33:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.network.neutron [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:33:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.policy [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a44d888f97048c9b47154e7700bb9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9333fa38e4335ae6b2eabc3a579c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:33:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Creating image(s)
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "/opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "/opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "/opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk 1073741824" returned: 0 in 0.054s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG nova.network.neutron [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Successfully created port: ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Cannot resize image /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'migration_context' on Instance uuid 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Ensure instance console log exists: /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Successfully updated port: ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquired lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-changed-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Refreshing instance network info cache due to event network-changed-ff8c538f-c133-4e83-b563-03067ff812f7. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] Acquiring lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updating instance_info_cache with network_info: [{"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Releasing lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Instance network_info: |[{"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] Acquired lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Refreshing network info cache for port ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Start _get_guest_xml network_info=[{"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:33:52 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:52 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1677502484',display_name='tempest-VolumesSnapshotTestJSON-instance-1677502484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1677502484',id=30,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdI0I/Vzbywdv+J7jREg6wYnMiI4F+pR9ZmTkKtBAfQTi6szdfmiksAXCzfFa22FVJ7LP73grSgHalM8/JKv07AuEz/xU/ZChGY+rGLbqGh2iwN8mUTA8FcnthBErfyHQ==',key_name='tempest-keypair-1513594986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75e9333fa38e4335ae6b2eabc3a579c0',ramdisk_id='',reservation_id='r-iaswx0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1813381307',owner_user_name='tempest-VolumesSnapshotTestJSON-1813381307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a44d888f97048c9b47154e7700bb9fa',uuid=022fd230-37ed-4a22-925c-64e9326c72fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converting VIF {"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'pci_devices' on Instance uuid 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:33:52 user nova-compute[72405]:   <uuid>022fd230-37ed-4a22-925c-64e9326c72fd</uuid>
Aug 08 23:33:52 user nova-compute[72405]:   <name>instance-0000001e</name>
Aug 08 23:33:52 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:33:52 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:33:52 user nova-compute[72405]:   <metadata>
Aug 08 23:33:52 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:33:52 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:33:52 user nova-compute[72405]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1677502484</nova:name>
Aug 08 23:33:52 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:33:52</nova:creationTime>
Aug 08 23:33:52 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:33:52 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:33:52 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:33:52 user nova-compute[72405]:       <nova:owner>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:user uuid="0a44d888f97048c9b47154e7700bb9fa">tempest-VolumesSnapshotTestJSON-1813381307-project-member</nova:user>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:project uuid="75e9333fa38e4335ae6b2eabc3a579c0">tempest-VolumesSnapshotTestJSON-1813381307</nova:project>
Aug 08 23:33:52 user nova-compute[72405]:       </nova:owner>
Aug 08 23:33:52 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:33:52 user nova-compute[72405]:       <nova:ports>
Aug 08 23:33:52 user nova-compute[72405]:         <nova:port uuid="ff8c538f-c133-4e83-b563-03067ff812f7">
Aug 08 23:33:52 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:33:52 user nova-compute[72405]:         </nova:port>
Aug 08 23:33:52 user nova-compute[72405]:       </nova:ports>
Aug 08 23:33:52 user nova-compute[72405]:     </nova:instance>
Aug 08 23:33:52 user nova-compute[72405]:   </metadata>
Aug 08 23:33:52 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:33:52 user nova-compute[72405]:     <system>
Aug 08 23:33:52 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:33:52 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:33:52 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:33:52 user nova-compute[72405]:       <entry name="serial">022fd230-37ed-4a22-925c-64e9326c72fd</entry>
Aug 08 23:33:52 user nova-compute[72405]:       <entry name="uuid">022fd230-37ed-4a22-925c-64e9326c72fd</entry>
Aug 08 23:33:52 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:33:52 user nova-compute[72405]:     </system>
Aug 08 23:33:52 user nova-compute[72405]:   </sysinfo>
Aug 08 23:33:52 user nova-compute[72405]:   <os>
Aug 08 23:33:52 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:33:52 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:33:52 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:33:52 user nova-compute[72405]:   </os>
Aug 08 23:33:52 user nova-compute[72405]:   <features>
Aug 08 23:33:52 user nova-compute[72405]:     <acpi/>
Aug 08 23:33:52 user nova-compute[72405]:     <apic/>
Aug 08 23:33:52 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:33:52 user nova-compute[72405]:   </features>
Aug 08 23:33:52 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:33:52 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:33:52 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:33:52 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:33:52 user nova-compute[72405]:   </clock>
Aug 08 23:33:52 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:33:52 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:33:52 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:33:52 user nova-compute[72405]:   </cpu>
Aug 08 23:33:52 user nova-compute[72405]:   <devices>
Aug 08 23:33:52 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:33:52 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:33:52 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk"/>
Aug 08 23:33:52 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:33:52 user nova-compute[72405]:     </disk>
Aug 08 23:33:52 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:33:52 user nova-compute[72405]:       <mac address="fa:16:3e:e1:a7:d5"/>
Aug 08 23:33:52 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:33:52 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:33:52 user nova-compute[72405]:       <target dev="tapff8c538f-c1"/>
Aug 08 23:33:52 user nova-compute[72405]:     </interface>
Aug 08 23:33:52 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:33:52 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/console.log" append="off"/>
Aug 08 23:33:52 user nova-compute[72405]:     </serial>
Aug 08 23:33:52 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:33:52 user nova-compute[72405]:     <video>
Aug 08 23:33:52 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:33:52 user nova-compute[72405]:     </video>
Aug 08 23:33:52 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:33:52 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:33:52 user nova-compute[72405]:     </rng>
Aug 08 23:33:52 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:33:52 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:33:52 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:33:52 user nova-compute[72405]:     </memballoon>
Aug 08 23:33:52 user nova-compute[72405]:   </devices>
Aug 08 23:33:52 user nova-compute[72405]: </domain>
Aug 08 23:33:52 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1677502484',display_name='tempest-VolumesSnapshotTestJSON-instance-1677502484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1677502484',id=30,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdI0I/Vzbywdv+J7jREg6wYnMiI4F+pR9ZmTkKtBAfQTi6szdfmiksAXCzfFa22FVJ7LP73grSgHalM8/JKv07AuEz/xU/ZChGY+rGLbqGh2iwN8mUTA8FcnthBErfyHQ==',key_name='tempest-keypair-1513594986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75e9333fa38e4335ae6b2eabc3a579c0',ramdisk_id='',reservation_id='r-iaswx0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1813381307',owner_user_name='tempest-VolumesSnapshotTestJSON-1813381307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a44d888f97048c9b47154e7700bb9fa',uuid=022fd230-37ed-4a22-925c-64e9326c72fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converting VIF {"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG os_vif [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff8c538f-c1, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff8c538f-c1, col_values=(('external_ids', {'iface-id': 'ff8c538f-c133-4e83-b563-03067ff812f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:a7:d5', 'vm-uuid': '022fd230-37ed-4a22-925c-64e9326c72fd'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:52 user nova-compute[72405]: INFO os_vif [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1')
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No VIF found with MAC fa:16:3e:e1:a7:d5, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updated VIF entry in instance network info cache for port ff8c538f-c133-4e83-b563-03067ff812f7. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:33:52 user nova-compute[72405]: DEBUG nova.network.neutron [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updating instance_info_cache with network_info: [{"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-18c80f16-455e-4563-ad8b-21a8179cc4b8 req-802a8508-8005-4233-ba81-f9454ce470d7 service nova] Releasing lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-c510f6e2-58e1-4032-b82a-fe2f26583964 req-aa28c61c-6744-4b9e-a199-2d3dd0c2be48 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c510f6e2-58e1-4032-b82a-fe2f26583964 req-aa28c61c-6744-4b9e-a199-2d3dd0c2be48 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c510f6e2-58e1-4032-b82a-fe2f26583964 req-aa28c61c-6744-4b9e-a199-2d3dd0c2be48 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c510f6e2-58e1-4032-b82a-fe2f26583964 req-aa28c61c-6744-4b9e-a199-2d3dd0c2be48 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-c510f6e2-58e1-4032-b82a-fe2f26583964 req-aa28c61c-6744-4b9e-a199-2d3dd0c2be48 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:54 user nova-compute[72405]: WARNING nova.compute.manager [req-c510f6e2-58e1-4032-b82a-fe2f26583964 req-aa28c61c-6744-4b9e-a199-2d3dd0c2be48 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state building and task_state spawning.
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Port f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 binding to destination host user is already ACTIVE {{(pid=72405) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Creating tmpfile /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/tmpv82d0j2n to verify with other compute node that the instance is on the same shared storage. {{(pid=72405) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537636.348234, 022fd230-37ed-4a22-925c-64e9326c72fd => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] VM Resumed (Lifecycle Event)
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Instance spawned successfully.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance destroyed successfully.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'resources' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f2e3cc-1e, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:33:56 user nova-compute[72405]: INFO os_vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e')
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537636.3549347, 022fd230-37ed-4a22-925c-64e9326c72fd => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] VM Started (Lifecycle Event)
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:33:56 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:56 user nova-compute[72405]: WARNING nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state building and task_state spawning.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:56 user nova-compute[72405]: WARNING nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state resized and task_state resize_reverting.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:33:56 user nova-compute[72405]: WARNING nova.compute.manager [req-5491bf61-8ce7-40d5-abb1-bbb5f6d42346 req-4740774d-1508-47ca-be75-fba42b03fc93 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state resized and task_state resize_reverting.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c5f0dd-b53a-4e76-9e87-68b624ae5ada]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc8cf02-8f04-4791-a4b3-2211b3bf981c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:33:56 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:33:56 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:33:56 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:33:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:33:56 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:33:56 user nova-compute[72405]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:33:56 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:33:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba5a1fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'): ({'sdf'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Removing single pathed devices sdf {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa3641-ecb5-458f-aa2e-ce72dc01c366]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c01bb-c6f0-40b8-8d1a-c23ac15ac157]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flushing IO for device /dev/sdf {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeb3238-9f62-48af-bd6f-730d589713ae]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: INFO nova.compute.manager [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Took 6.41 seconds to build instance.
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2ce49d7c-b5fb-4fd7-9ee0-a621d8e7a883 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.553s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[55371fb2-f701-4880-8ca6-5a584342125b]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3fdb0-f83d-42b6-8f9a-3e66c4277214]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8ca32-366d-41f7-8352-be901a0de58b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]
Aug 08 23:33:56 user nova-compute[72405]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.
Aug 08 23:33:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aa5ac8-a0ef-403c-aa3c-15a05ae6b00a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== disconnect_volume: return (290ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:33:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:33:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:33:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:33:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'migration_context' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.422s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:33:58 user nova-compute[72405]: INFO nova.compute.manager [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Swapping old allocation on dict_keys(['488a0e0f-53ed-47ef-b1b6-c809d06d6be1']) held by migration 6af202c9-a8e7-43bf-affd-7985a25456c1 for instance
Aug 08 23:33:58 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Overwriting current allocation {'allocations': {'488a0e0f-53ed-47ef-b1b6-c809d06d6be1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 36}}, 'project_id': 'af7781e7654e447fb13a10725e45a2fe', 'user_id': '1fced4d4747e4e3abb0772b956bedba7', 'consumer_generation': 1} on consumer 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquired lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG nova.network.neutron [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Releasing lock "refresh_cache-9f105082-c7cc-4b7d-b6d4-04a293e832cf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG os_brick.utils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822c9a0-6c3f-4c96-824e-8d8d6a99b4dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a093f3-c535-4af9-adfe-9514f3df597a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c72163-4b05-4b94-84ca-acebb66c4d49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f75dd8-4b36-4b1f-8369-1b3a4f7ed7f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:33:59 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:33:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d62e4a1-88ba-4e0c-a1e3-0f7cfb53ac36]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:33:59 user nova-compute[72405]: DEBUG os_brick.utils [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:06 user nova-compute[72405]: INFO nova.compute.manager [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Unrescuing
Aug 08 23:34:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'flavor' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-74d013d2-aa39-4f02-8e95-76eaee0ba7b7 req-e4658615-5f8f-4640-99cf-d77f3ec60a73 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74d013d2-aa39-4f02-8e95-76eaee0ba7b7 req-e4658615-5f8f-4640-99cf-d77f3ec60a73 service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74d013d2-aa39-4f02-8e95-76eaee0ba7b7 req-e4658615-5f8f-4640-99cf-d77f3ec60a73 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74d013d2-aa39-4f02-8e95-76eaee0ba7b7 req-e4658615-5f8f-4640-99cf-d77f3ec60a73 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-74d013d2-aa39-4f02-8e95-76eaee0ba7b7 req-e4658615-5f8f-4640-99cf-d77f3ec60a73 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:07 user nova-compute[72405]: WARNING nova.compute.manager [req-74d013d2-aa39-4f02-8e95-76eaee0ba7b7 req-e4658615-5f8f-4640-99cf-d77f3ec60a73 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:34:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing instance network info cache due to event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:34:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance destroyed successfully.
Aug 08 23:34:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Starting finish_revert_migration {{(pid=72405) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start _get_guest_xml network_info=[{"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f2c2d98f-dd9f-49aa-958e-53fb5faa6420', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9f105082-c7cc-4b7d-b6d4-04a293e832cf', 'attached_at': '2023-08-08T23:34:08.000000', 'detached_at': '', 'volume_id': 'c092ae02-9d27-42ef-b4c5-f0953aa54ead', 'serial': 'c092ae02-9d27-42ef-b4c5-f0953aa54ead'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:34:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:34:08 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:08 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:08 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updated VIF entry in instance network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-056f728e-a43f-4063-8a96-ae2eac53accc req-f07fa0a5-119f-4528-b6f3-6fa6d02c2f7b service nova] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba3257-d948-49ca-8c31-7c24af1117af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:34:08 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ef9b8-6ac5-4db1-9f53-781edc95b36c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead] added
Aug 08 23:34:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f8dfa-d467-4216-83d4-373a4daa596b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a2a474-8a46-4f4e-9351-93ee78c65e08]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQAdeXBW {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQAdeXBW" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcf4fde-2a76-4fca-8007-7a7881c974ad]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQAdeXBW'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b56b2-f661-4579-98fe-efd9f2709464]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d2d95-bbb0-4e65-a7c9-86e7b5deb91b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5d0bb2-0590-4f4b-a6a3-9340621dc5b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]
Aug 08 23:34:08 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.
Aug 08 23:34:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4930ea6-e34a-49a3-a1cf-40789fab673b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacc6a01-6d3b-4741-bbdd-26fdff1096cc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:08 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6c14f5-a35a-40f2-9a6b-365af4c8e791]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:09 user nova-compute[72405]: WARNING nova.compute.manager [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:09 user nova-compute[72405]: WARNING nova.compute.manager [req-80ea849f-0dbb-4c1f-a1bf-c614537227cf req-cc9cfca4-46c8-41da-9996-71748fa0a03e service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:34:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26439356237323937', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439356237323937', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:34:09 user nova-compute[72405]:   <uuid>9f105082-c7cc-4b7d-b6d4-04a293e832cf</uuid>
Aug 08 23:34:09 user nova-compute[72405]:   <name>instance-00000011</name>
Aug 08 23:34:09 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:34:09 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:34:09 user nova-compute[72405]:   <metadata>
Aug 08 23:34:09 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:34:09 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:34:09 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherB-server-1050796295</nova:name>
Aug 08 23:34:09 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:34:08</nova:creationTime>
Aug 08 23:34:09 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:34:09 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:34:09 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:34:09 user nova-compute[72405]:       <nova:owner>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:user uuid="1fced4d4747e4e3abb0772b956bedba7">tempest-ServerActionsTestOtherB-1153417891-project-member</nova:user>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:project uuid="af7781e7654e447fb13a10725e45a2fe">tempest-ServerActionsTestOtherB-1153417891</nova:project>
Aug 08 23:34:09 user nova-compute[72405]:       </nova:owner>
Aug 08 23:34:09 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:34:09 user nova-compute[72405]:       <nova:ports>
Aug 08 23:34:09 user nova-compute[72405]:         <nova:port uuid="f9f2e3cc-1e64-475b-9e4a-f1a0db25b771">
Aug 08 23:34:09 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:34:09 user nova-compute[72405]:         </nova:port>
Aug 08 23:34:09 user nova-compute[72405]:       </nova:ports>
Aug 08 23:34:09 user nova-compute[72405]:     </nova:instance>
Aug 08 23:34:09 user nova-compute[72405]:   </metadata>
Aug 08 23:34:09 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:34:09 user nova-compute[72405]:     <system>
Aug 08 23:34:09 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:34:09 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:34:09 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:34:09 user nova-compute[72405]:       <entry name="serial">9f105082-c7cc-4b7d-b6d4-04a293e832cf</entry>
Aug 08 23:34:09 user nova-compute[72405]:       <entry name="uuid">9f105082-c7cc-4b7d-b6d4-04a293e832cf</entry>
Aug 08 23:34:09 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:34:09 user nova-compute[72405]:     </system>
Aug 08 23:34:09 user nova-compute[72405]:   </sysinfo>
Aug 08 23:34:09 user nova-compute[72405]:   <os>
Aug 08 23:34:09 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:34:09 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:34:09 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:34:09 user nova-compute[72405]:   </os>
Aug 08 23:34:09 user nova-compute[72405]:   <features>
Aug 08 23:34:09 user nova-compute[72405]:     <acpi/>
Aug 08 23:34:09 user nova-compute[72405]:     <apic/>
Aug 08 23:34:09 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:34:09 user nova-compute[72405]:   </features>
Aug 08 23:34:09 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:34:09 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:34:09 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:34:09 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:34:09 user nova-compute[72405]:   </clock>
Aug 08 23:34:09 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:34:09 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:34:09 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:34:09 user nova-compute[72405]:   </cpu>
Aug 08 23:34:09 user nova-compute[72405]:   <devices>
Aug 08 23:34:09 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:34:09 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:34:09 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk"/>
Aug 08 23:34:09 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:34:09 user nova-compute[72405]:     </disk>
Aug 08 23:34:09 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:34:09 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:34:09 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:34:09 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:34:09 user nova-compute[72405]:       <serial>c092ae02-9d27-42ef-b4c5-f0953aa54ead</serial>
Aug 08 23:34:09 user nova-compute[72405]:     </disk>
Aug 08 23:34:09 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:34:09 user nova-compute[72405]:       <mac address="fa:16:3e:2f:cf:a3"/>
Aug 08 23:34:09 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:34:09 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:34:09 user nova-compute[72405]:       <target dev="tapf9f2e3cc-1e"/>
Aug 08 23:34:09 user nova-compute[72405]:     </interface>
Aug 08 23:34:09 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:34:09 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/console.log" append="off"/>
Aug 08 23:34:09 user nova-compute[72405]:     </serial>
Aug 08 23:34:09 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:34:09 user nova-compute[72405]:     <video>
Aug 08 23:34:09 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:34:09 user nova-compute[72405]:     </video>
Aug 08 23:34:09 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:34:09 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:34:09 user nova-compute[72405]:     </rng>
Aug 08 23:34:09 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:34:09 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:34:09 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:34:09 user nova-compute[72405]:     </memballoon>
Aug 08 23:34:09 user nova-compute[72405]:   </devices>
Aug 08 23:34:09 user nova-compute[72405]: </domain>
Aug 08 23:34:09 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG os_vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9f2e3cc-1e, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9f2e3cc-1e, col_values=(('external_ids', {'iface-id': 'f9f2e3cc-1e64-475b-9e4a-f1a0db25b771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:cf:a3', 'vm-uuid': '9f105082-c7cc-4b7d-b6d4-04a293e832cf'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: INFO os_vif [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e')
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing instance network info cache due to event network-changed-7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] Acquiring lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] Acquired lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Refreshing network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updated VIF entry in instance network info cache for port 7f005eac-6485-491f-8fdf-c65a3a2d958e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [{"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b37509f6-1139-47eb-929e-f0a38ae1428c req-0042c47e-f9a8-47e3-a4c1-eb34cf853f15 service nova] Releasing lock "refresh_cache-f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:10 user nova-compute[72405]: INFO nova.compute.manager [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Unshelving
Aug 08 23:34:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG nova.objects.instance [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'pci_requests' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG nova.objects.instance [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:10 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:34:10 user nova-compute[72405]: INFO nova.compute.claims [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Claim successful on node user
Aug 08 23:34:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-a1cf6cf0-65d5-458c-816d-7a45baab4630 req-5ec9f9be-5506-4984-a657-fbda73fbe22f service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a1cf6cf0-65d5-458c-816d-7a45baab4630 req-5ec9f9be-5506-4984-a657-fbda73fbe22f service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a1cf6cf0-65d5-458c-816d-7a45baab4630 req-5ec9f9be-5506-4984-a657-fbda73fbe22f service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a1cf6cf0-65d5-458c-816d-7a45baab4630 req-5ec9f9be-5506-4984-a657-fbda73fbe22f service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-a1cf6cf0-65d5-458c-816d-7a45baab4630 req-5ec9f9be-5506-4984-a657-fbda73fbe22f service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:11 user nova-compute[72405]: WARNING nova.compute.manager [req-a1cf6cf0-65d5-458c-816d-7a45baab4630 req-5ec9f9be-5506-4984-a657-fbda73fbe22f service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6d4d0123-6f87-42a7-bb33-b93953a406e4 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537651.4691627, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Resumed (Lifecycle Event)
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537636.3590903, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:11 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Stopped (Lifecycle Event)
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-064d07ac-7dee-4d2c-97f5-465369adb81e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:34:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537651.473628, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Started (Lifecycle Event)
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:11 user nova-compute[72405]: INFO nova.network.neutron [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating port 418e6ca5-f552-4992-b7e5-26daea416207 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:34:13 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Creating image(s)
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.objects.instance [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "878d731a102fb9968766bb6d83e0747c055829cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "878d731a102fb9968766bb6d83e0747c055829cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537653.3749871, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:13 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Resumed (Lifecycle Event)
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:13 user nova-compute[72405]: WARNING nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state resized and task_state resize_reverting.
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:13 user nova-compute[72405]: WARNING nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state resized and task_state resize_reverting.
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-changed-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing instance network info cache due to event network-changed-418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Acquiring lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Acquired lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.network.neutron [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Refreshing network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:34:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance running successfully.
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] finish_revert_migration finished successfully. {{(pid=72405) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:34:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537653.3751206, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Started (Lifecycle Event)
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.part --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.virt.images [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] 2d45eff0-7fe7-45e2-a945-5682230d1aa6 was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.part /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 08 23:34:14 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:34:14 user nova-compute[72405]: INFO nova.compute.claims [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Claim successful on node user
Aug 08 23:34:15 user nova-compute[72405]: INFO nova.compute.manager [None req-1bd21107-3e6b-43ef-87ad-a3859c9cd312 tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance to original state: 'active'
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.part /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.converted" returned: 0 in 0.623s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "878d731a102fb9968766bb6d83e0747c055829cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.300s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updated VIF entry in instance network info cache for port 418e6ca5-f552-4992-b7e5-26daea416207. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "878d731a102fb9968766bb6d83e0747c055829cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "878d731a102fb9968766bb6d83e0747c055829cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7217178b-8b62-4be4-849c-77a65a6f32e4 req-9b885e4a-e971-43d8-a98b-a708fa37d763 service nova] Releasing lock "refresh_cache-3ff81abc-acf0-4d6e-b88b-3db62c9f9080" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.958s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf --force-share --output=json" returned: 0 in 0.173s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf,backing_fmt=raw /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf,backing_fmt=raw /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk 1073741824" returned: 0 in 0.056s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "878d731a102fb9968766bb6d83e0747c055829cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:34:16 user nova-compute[72405]: DEBUG nova.policy [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9b5279220af4cc4a364014419168ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf26de781ef4462914d7f32168b3192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:34:16 user nova-compute[72405]: INFO nova.virt.block_device [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Booting with volume-backed-image ed72958c-30b3-4e1d-9bb6-9c0404b96321 at /dev/vda
Aug 08 23:34:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'migration_context' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Rebasing disk image.
Aug 08 23:34:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b -F raw /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Successfully created port: 607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Successfully updated port: 607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-changed-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Refreshing instance network info cache due to event network-changed-607ff757-39b7-4fab-b733-a5866fa0709c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] Acquiring lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:34:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating instance_info_cache with network_info: [{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance network_info: |[{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] Acquired lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Refreshing network info cache for port 607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updated VIF entry in instance network info cache for port 607ff757-39b7-4fab-b733-a5866fa0709c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating instance_info_cache with network_info: [{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d2a67953-ebe2-4140-8b78-13598c35c898 req-c8e118e2-893b-4a54-845c-63563e8eadb7 service nova] Releasing lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b -F raw /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk" returned: 0 in 2.455s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Ensure instance console log exists: /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Start _get_guest_xml network_info=[{"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='566edc32977fe6bd3fe86d1b092dee86',container_format='bare',created_at=2023-08-08T23:32:17Z,direct_url=<?>,disk_format='qcow2',id=2d45eff0-7fe7-45e2-a945-5682230d1aa6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1330613417-shelved',owner='94f6dc799f1b4698b15a3ea91c8dbea9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-08T23:32:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:34:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='566edc32977fe6bd3fe86d1b092dee86',container_format='bare',created_at=2023-08-08T23:32:17Z,direct_url=<?>,disk_format='qcow2',id=2d45eff0-7fe7-45e2-a945-5682230d1aa6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1330613417-shelved',owner='94f6dc799f1b4698b15a3ea91c8dbea9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-08T23:32:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330613417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330613417',id=24,image_ref='2d45eff0-7fe7-45e2-a945-5682230d1aa6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-779216247',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-gjwgg0im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member',shelved_at='2023-08-08T23:32:24.682693',shelved_host='user',shelved_image_id='2d45eff0-7fe7-45e2-a945-5682230d1aa6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=3ff81abc-acf0-4d6e-b88b-3db62c9f9080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:34:18 user nova-compute[72405]:   <uuid>3ff81abc-acf0-4d6e-b88b-3db62c9f9080</uuid>
Aug 08 23:34:18 user nova-compute[72405]:   <name>instance-00000018</name>
Aug 08 23:34:18 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:34:18 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:34:18 user nova-compute[72405]:   <metadata>
Aug 08 23:34:18 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:34:18 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:34:18 user nova-compute[72405]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1330613417</nova:name>
Aug 08 23:34:18 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:34:18</nova:creationTime>
Aug 08 23:34:18 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:34:18 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:34:18 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:34:18 user nova-compute[72405]:       <nova:owner>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:user uuid="fb25719ffe4c467e8afc3f6b8fe4d712">tempest-AttachVolumeShelveTestJSON-1695202964-project-member</nova:user>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:project uuid="94f6dc799f1b4698b15a3ea91c8dbea9">tempest-AttachVolumeShelveTestJSON-1695202964</nova:project>
Aug 08 23:34:18 user nova-compute[72405]:       </nova:owner>
Aug 08 23:34:18 user nova-compute[72405]:       <nova:root type="image" uuid="2d45eff0-7fe7-45e2-a945-5682230d1aa6"/>
Aug 08 23:34:18 user nova-compute[72405]:       <nova:ports>
Aug 08 23:34:18 user nova-compute[72405]:         <nova:port uuid="418e6ca5-f552-4992-b7e5-26daea416207">
Aug 08 23:34:18 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 08 23:34:18 user nova-compute[72405]:         </nova:port>
Aug 08 23:34:18 user nova-compute[72405]:       </nova:ports>
Aug 08 23:34:18 user nova-compute[72405]:     </nova:instance>
Aug 08 23:34:18 user nova-compute[72405]:   </metadata>
Aug 08 23:34:18 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:34:18 user nova-compute[72405]:     <system>
Aug 08 23:34:18 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:34:18 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:34:18 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:34:18 user nova-compute[72405]:       <entry name="serial">3ff81abc-acf0-4d6e-b88b-3db62c9f9080</entry>
Aug 08 23:34:18 user nova-compute[72405]:       <entry name="uuid">3ff81abc-acf0-4d6e-b88b-3db62c9f9080</entry>
Aug 08 23:34:18 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:34:18 user nova-compute[72405]:     </system>
Aug 08 23:34:18 user nova-compute[72405]:   </sysinfo>
Aug 08 23:34:18 user nova-compute[72405]:   <os>
Aug 08 23:34:18 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:34:18 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:34:18 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:34:18 user nova-compute[72405]:   </os>
Aug 08 23:34:18 user nova-compute[72405]:   <features>
Aug 08 23:34:18 user nova-compute[72405]:     <acpi/>
Aug 08 23:34:18 user nova-compute[72405]:     <apic/>
Aug 08 23:34:18 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:34:18 user nova-compute[72405]:   </features>
Aug 08 23:34:18 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:34:18 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:34:18 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:34:18 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:34:18 user nova-compute[72405]:   </clock>
Aug 08 23:34:18 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:34:18 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:34:18 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:34:18 user nova-compute[72405]:   </cpu>
Aug 08 23:34:18 user nova-compute[72405]:   <devices>
Aug 08 23:34:18 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:34:18 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:34:18 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk"/>
Aug 08 23:34:18 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:34:18 user nova-compute[72405]:     </disk>
Aug 08 23:34:18 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:34:18 user nova-compute[72405]:       <mac address="fa:16:3e:6c:3b:64"/>
Aug 08 23:34:18 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:34:18 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:34:18 user nova-compute[72405]:       <target dev="tap418e6ca5-f5"/>
Aug 08 23:34:18 user nova-compute[72405]:     </interface>
Aug 08 23:34:18 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:34:18 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/console.log" append="off"/>
Aug 08 23:34:18 user nova-compute[72405]:     </serial>
Aug 08 23:34:18 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:34:18 user nova-compute[72405]:     <video>
Aug 08 23:34:18 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:34:18 user nova-compute[72405]:     </video>
Aug 08 23:34:18 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:34:18 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:34:18 user nova-compute[72405]:     </rng>
Aug 08 23:34:18 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:34:18 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:34:18 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:34:18 user nova-compute[72405]:     </memballoon>
Aug 08 23:34:18 user nova-compute[72405]:   </devices>
Aug 08 23:34:18 user nova-compute[72405]: </domain>
Aug 08 23:34:18 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330613417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330613417',id=24,image_ref='2d45eff0-7fe7-45e2-a945-5682230d1aa6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-779216247',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-gjwgg0im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member',shelved_at='2023-08-08T23:32:24.682693',shelved_host='user',shelved_image_id='2d45eff0-7fe7-45e2-a945-5682230d1aa6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=3ff81abc-acf0-4d6e-b88b-3db62c9f9080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG os_vif [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap418e6ca5-f5, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap418e6ca5-f5, col_values=(('external_ids', {'iface-id': '418e6ca5-f552-4992-b7e5-26daea416207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:3b:64', 'vm-uuid': '3ff81abc-acf0-4d6e-b88b-3db62c9f9080'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:18 user nova-compute[72405]: INFO os_vif [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5')
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:34:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] No VIF found with MAC fa:16:3e:6c:3b:64, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:34:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-24e0e00b-05cf-42c6-983c-b332774206bd req-835af8bf-b245-495b-940d-b574993bd003 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-24e0e00b-05cf-42c6-983c-b332774206bd req-835af8bf-b245-495b-940d-b574993bd003 service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-24e0e00b-05cf-42c6-983c-b332774206bd req-835af8bf-b245-495b-940d-b574993bd003 service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-24e0e00b-05cf-42c6-983c-b332774206bd req-835af8bf-b245-495b-940d-b574993bd003 service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-24e0e00b-05cf-42c6-983c-b332774206bd req-835af8bf-b245-495b-940d-b574993bd003 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:21 user nova-compute[72405]: WARNING nova.compute.manager [req-24e0e00b-05cf-42c6-983c-b332774206bd req-835af8bf-b245-495b-940d-b574993bd003 service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 08 23:34:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-4fff4dbc-993e-4b36-853c-d98c716f5230 req-58efe571-2982-4b8f-b421-766303eb796a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4fff4dbc-993e-4b36-853c-d98c716f5230 req-58efe571-2982-4b8f-b421-766303eb796a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4fff4dbc-993e-4b36-853c-d98c716f5230 req-58efe571-2982-4b8f-b421-766303eb796a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4fff4dbc-993e-4b36-853c-d98c716f5230 req-58efe571-2982-4b8f-b421-766303eb796a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-4fff4dbc-993e-4b36-853c-d98c716f5230 req-58efe571-2982-4b8f-b421-766303eb796a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:23 user nova-compute[72405]: WARNING nova.compute.manager [req-4fff4dbc-993e-4b36-853c-d98c716f5230 req-58efe571-2982-4b8f-b421-766303eb796a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537663.4298608, 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] VM Resumed (Lifecycle Event)
Aug 08 23:34:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance spawned successfully.
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537663.4301093, 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] VM Started (Lifecycle Event)
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:34:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-589a2a29-6276-45fe-9548-dc0793ea6471 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.108s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG os_brick.utils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[335e9b49-e80a-4c99-9187-b68ff843f502]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[779aba0b-9572-45b5-88f1-3e76da8d8b68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.067s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[714edcb0-bcec-4fd3-818c-b5e2eb60643c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490e248-9895-47b5-aa6c-1f743af896e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:34:27 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:34:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f714821a-4e83-47fe-afc9-1955edfc1e4a]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG os_brick.utils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:27 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating existing volume attachment record: 8d0a3e2a-3fbf-4b6e-90eb-e19cce2569d6 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:34:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:30 user nova-compute[72405]: INFO nova.compute.manager [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Terminating instance
Aug 08 23:34:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e7eab51-7beb-476b-a050-34a39952e551 req-67600dc5-22fe-4a25-878f-1b31e9e1d6ab service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-vif-unplugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e7eab51-7beb-476b-a050-34a39952e551 req-67600dc5-22fe-4a25-878f-1b31e9e1d6ab service nova] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e7eab51-7beb-476b-a050-34a39952e551 req-67600dc5-22fe-4a25-878f-1b31e9e1d6ab service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e7eab51-7beb-476b-a050-34a39952e551 req-67600dc5-22fe-4a25-878f-1b31e9e1d6ab service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e7eab51-7beb-476b-a050-34a39952e551 req-67600dc5-22fe-4a25-878f-1b31e9e1d6ab service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] No waiting events found dispatching network-vif-unplugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e7eab51-7beb-476b-a050-34a39952e551 req-67600dc5-22fe-4a25-878f-1b31e9e1d6ab service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-vif-unplugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Instance destroyed successfully.
Aug 08 23:34:31 user nova-compute[72405]: DEBUG nova.objects.instance [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lazy-loading 'resources' on Instance uuid befa7939-87a3-4258-9d44-dd986d9d5ea4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:32:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1932563391',display_name='tempest-VolumesActionsTest-instance-1932563391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1932563391',id=26,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10125c137a084adfaf04047babb4e183',ramdisk_id='',reservation_id='r-fgci1u46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2053940124',owner_user_name='tempest-VolumesActionsTest-2053940124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:32:40Z,user_data=None,user_id='d4881dc8c73248bb9ccaabc9aa0b485c',uuid=befa7939-87a3-4258-9d44-dd986d9d5ea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Converting VIF {"id": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "address": "fa:16:3e:b6:38:46", "network": {"id": "6b714493-c9da-41d7-98ed-c123dcc5c008", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101780519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10125c137a084adfaf04047babb4e183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d7b689-0c", "ovs_interfaceid": "d0d7b689-0c6b-493c-afc1-d82f5fb454a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG os_vif [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0d7b689-0c, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:34:31 user nova-compute[72405]: INFO os_vif [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:46,bridge_name='br-int',has_traffic_filtering=True,id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8,network=Network(6b714493-c9da-41d7-98ed-c123dcc5c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d7b689-0c')
Aug 08 23:34:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Deleting instance files /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4_del
Aug 08 23:34:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Deletion of /opt/stack/data/nova/instances/befa7939-87a3-4258-9d44-dd986d9d5ea4_del complete
Aug 08 23:34:31 user nova-compute[72405]: INFO nova.compute.manager [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 08 23:34:31 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:34:31 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:32 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Took 0.58 seconds to deallocate network for instance.
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-b7d35685-d2b4-417e-b629-054f0f0ceaaa req-28eb9d36-db00-43c8-ab83-fbc0e9f82ad2 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-vif-deleted-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:32 user nova-compute[72405]: INFO nova.compute.manager [req-b7d35685-d2b4-417e-b629-054f0f0ceaaa req-28eb9d36-db00-43c8-ab83-fbc0e9f82ad2 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Neutron deleted interface d0d7b689-0c6b-493c-afc1-d82f5fb454a8; detaching it from the instance and deleting it from the info cache
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.network.neutron [req-b7d35685-d2b4-417e-b629-054f0f0ceaaa req-28eb9d36-db00-43c8-ab83-fbc0e9f82ad2 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-b7d35685-d2b4-417e-b629-054f0f0ceaaa req-28eb9d36-db00-43c8-ab83-fbc0e9f82ad2 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Detach interface failed, port_id=d0d7b689-0c6b-493c-afc1-d82f5fb454a8, reason: Instance befa7939-87a3-4258-9d44-dd986d9d5ea4 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:32 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Deleted allocations for instance befa7939-87a3-4258-9d44-dd986d9d5ea4
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-765ca18c-7bc2-4471-be3c-af5b0a35cf3e tempest-VolumesActionsTest-2053940124 tempest-VolumesActionsTest-2053940124-project-member] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-621d33d3-2b94-4d4d-b374-3a833bdd523b req-034ec949-0394-49fc-9a6c-f653655ac086 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received event network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-621d33d3-2b94-4d4d-b374-3a833bdd523b req-034ec949-0394-49fc-9a6c-f653655ac086 service nova] Acquiring lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-621d33d3-2b94-4d4d-b374-3a833bdd523b req-034ec949-0394-49fc-9a6c-f653655ac086 service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-621d33d3-2b94-4d4d-b374-3a833bdd523b req-034ec949-0394-49fc-9a6c-f653655ac086 service nova] Lock "befa7939-87a3-4258-9d44-dd986d9d5ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-621d33d3-2b94-4d4d-b374-3a833bdd523b req-034ec949-0394-49fc-9a6c-f653655ac086 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] No waiting events found dispatching network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:32 user nova-compute[72405]: WARNING nova.compute.manager [req-621d33d3-2b94-4d4d-b374-3a833bdd523b req-034ec949-0394-49fc-9a6c-f653655ac086 service nova] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Received unexpected event network-vif-plugged-d0d7b689-0c6b-493c-afc1-d82f5fb454a8 for instance with vm_state deleted and task_state None.
Aug 08 23:34:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:34:36 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Creating image(s)
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Ensure instance console log exists: /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Start _get_guest_xml network_info=[{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d0a3e2a-3fbf-4b6e-90eb-e19cce2569d6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b410b764-3eab-40f1-9e27-81cefe78b0e3', 'attached_at': '', 'detached_at': '', 'volume_id': '0d20d2dc-a7a5-4a7d-9915-b4981a666d92', 'serial': '0d20d2dc-a7a5-4a7d-9915-b4981a666d92'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:34:36 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:36 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:34:36 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:36 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:36 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a475485d-c71d-4dd0-b289-a5c0b405cefd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:34:36 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3a8e45-d8bd-497f-988d-afeb0fa2d798]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92] added
Aug 08 23:34:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da58c05-de2d-4f87-8d7b-640b0e2033ce]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ac30e-f9e9-4bb4-81c6-c9ba04f35914]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUwCPYgc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUwCPYgc" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d7b59-3e04-43d0-ae13-e154454ecacc]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yUwCPYgc'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[31960768-db94-40d4-88b2-3b8d5ef3d72e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae83793-f9cf-4f68-ab1e-c770c1e6f86a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e336a922-cee9-4817-9d05-76147bdd5a3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260]
Aug 08 23:34:36 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260] successful.
Aug 08 23:34:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de59481c-95be-449a-86e9-7b485cd6d5b8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c66c35-ec42-4108-8018-d3a682eaeaea]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:36 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:36 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:34:36 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[938468c0-0e8c-48c0-8875-a8f5c555e4c5]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26564653464323561', 'path': '/dev/sdf'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564653464323561', 'path': '/dev/sdf'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-859653112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-859653112',id=31,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-9o558hjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:34:16Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=b410b764-3eab-40f1-9e27-81cefe78b0e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'pci_devices' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:34:38 user nova-compute[72405]:   <uuid>b410b764-3eab-40f1-9e27-81cefe78b0e3</uuid>
Aug 08 23:34:38 user nova-compute[72405]:   <name>instance-0000001f</name>
Aug 08 23:34:38 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:34:38 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:34:38 user nova-compute[72405]:   <metadata>
Aug 08 23:34:38 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:34:38 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:34:38 user nova-compute[72405]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-859653112</nova:name>
Aug 08 23:34:38 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:34:36</nova:creationTime>
Aug 08 23:34:38 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:34:38 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:34:38 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:34:38 user nova-compute[72405]:       <nova:owner>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:user uuid="d9b5279220af4cc4a364014419168ae8">tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member</nova:user>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:project uuid="1bf26de781ef4462914d7f32168b3192">tempest-ServerBootFromVolumeStableRescueTest-1549652719</nova:project>
Aug 08 23:34:38 user nova-compute[72405]:       </nova:owner>
Aug 08 23:34:38 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:34:38 user nova-compute[72405]:       <nova:ports>
Aug 08 23:34:38 user nova-compute[72405]:         <nova:port uuid="607ff757-39b7-4fab-b733-a5866fa0709c">
Aug 08 23:34:38 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 08 23:34:38 user nova-compute[72405]:         </nova:port>
Aug 08 23:34:38 user nova-compute[72405]:       </nova:ports>
Aug 08 23:34:38 user nova-compute[72405]:     </nova:instance>
Aug 08 23:34:38 user nova-compute[72405]:   </metadata>
Aug 08 23:34:38 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:34:38 user nova-compute[72405]:     <system>
Aug 08 23:34:38 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:34:38 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:34:38 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:34:38 user nova-compute[72405]:       <entry name="serial">b410b764-3eab-40f1-9e27-81cefe78b0e3</entry>
Aug 08 23:34:38 user nova-compute[72405]:       <entry name="uuid">b410b764-3eab-40f1-9e27-81cefe78b0e3</entry>
Aug 08 23:34:38 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:34:38 user nova-compute[72405]:     </system>
Aug 08 23:34:38 user nova-compute[72405]:   </sysinfo>
Aug 08 23:34:38 user nova-compute[72405]:   <os>
Aug 08 23:34:38 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:34:38 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:34:38 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:34:38 user nova-compute[72405]:   </os>
Aug 08 23:34:38 user nova-compute[72405]:   <features>
Aug 08 23:34:38 user nova-compute[72405]:     <acpi/>
Aug 08 23:34:38 user nova-compute[72405]:     <apic/>
Aug 08 23:34:38 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:34:38 user nova-compute[72405]:   </features>
Aug 08 23:34:38 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:34:38 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:34:38 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:34:38 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:34:38 user nova-compute[72405]:   </clock>
Aug 08 23:34:38 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:34:38 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:34:38 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:34:38 user nova-compute[72405]:   </cpu>
Aug 08 23:34:38 user nova-compute[72405]:   <devices>
Aug 08 23:34:38 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:34:38 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:34:38 user nova-compute[72405]:       <source dev="/dev/sdf"/>
Aug 08 23:34:38 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:34:38 user nova-compute[72405]:       <serial>0d20d2dc-a7a5-4a7d-9915-b4981a666d92</serial>
Aug 08 23:34:38 user nova-compute[72405]:     </disk>
Aug 08 23:34:38 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:34:38 user nova-compute[72405]:       <mac address="fa:16:3e:11:0a:0b"/>
Aug 08 23:34:38 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:34:38 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:34:38 user nova-compute[72405]:       <target dev="tap607ff757-39"/>
Aug 08 23:34:38 user nova-compute[72405]:     </interface>
Aug 08 23:34:38 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:34:38 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/console.log" append="off"/>
Aug 08 23:34:38 user nova-compute[72405]:     </serial>
Aug 08 23:34:38 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:34:38 user nova-compute[72405]:     <video>
Aug 08 23:34:38 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:34:38 user nova-compute[72405]:     </video>
Aug 08 23:34:38 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:34:38 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:34:38 user nova-compute[72405]:     </rng>
Aug 08 23:34:38 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:34:38 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:34:38 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:34:38 user nova-compute[72405]:     </memballoon>
Aug 08 23:34:38 user nova-compute[72405]:   </devices>
Aug 08 23:34:38 user nova-compute[72405]: </domain>
Aug 08 23:34:38 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-859653112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-859653112',id=31,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-9o558hjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:34:16Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=b410b764-3eab-40f1-9e27-81cefe78b0e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG os_vif [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap607ff757-39, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap607ff757-39, col_values=(('external_ids', {'iface-id': '607ff757-39b7-4fab-b733-a5866fa0709c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:0a:0b', 'vm-uuid': 'b410b764-3eab-40f1-9e27-81cefe78b0e3'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:38 user nova-compute[72405]: INFO os_vif [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39')
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:34:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No VIF found with MAC fa:16:3e:11:0a:0b, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:39 user nova-compute[72405]: INFO nova.compute.manager [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Detaching volume 962aa7c4-12e6-44e8-a72c-074c3c3bf9f8
Aug 08 23:34:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:39 user nova-compute[72405]: INFO nova.virt.block_device [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Attempting to driver detach volume 962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 from mountpoint /dev/vdb
Aug 08 23:34:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Attempting to detach device vdb from instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:34:39 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:34:39 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:34:39 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:34:39 user nova-compute[72405]:   <serial>962aa7c4-12e6-44e8-a72c-074c3c3bf9f8</serial>
Aug 08 23:34:39 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:34:39 user nova-compute[72405]: </disk>
Aug 08 23:34:39 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:34:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Successfully detached device vdb from instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 from the persistent domain config.
Aug 08 23:34:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:34:39 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:34:39 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:34:39 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:34:39 user nova-compute[72405]:   <serial>962aa7c4-12e6-44e8-a72c-074c3c3bf9f8</serial>
Aug 08 23:34:39 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:34:39 user nova-compute[72405]: </disk>
Aug 08 23:34:39 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6a039d7-1fe7-4b81-af12-a89e5a7a113d req-c8dc8970-b7f7-4faf-a7e3-77daa3b90b2f service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6a039d7-1fe7-4b81-af12-a89e5a7a113d req-c8dc8970-b7f7-4faf-a7e3-77daa3b90b2f service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6a039d7-1fe7-4b81-af12-a89e5a7a113d req-c8dc8970-b7f7-4faf-a7e3-77daa3b90b2f service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6a039d7-1fe7-4b81-af12-a89e5a7a113d req-c8dc8970-b7f7-4faf-a7e3-77daa3b90b2f service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6a039d7-1fe7-4b81-af12-a89e5a7a113d req-c8dc8970-b7f7-4faf-a7e3-77daa3b90b2f service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:39 user nova-compute[72405]: WARNING nova.compute.manager [req-e6a039d7-1fe7-4b81-af12-a89e5a7a113d req-c8dc8970-b7f7-4faf-a7e3-77daa3b90b2f service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state building and task_state spawning.
Aug 08 23:34:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537680.0099401, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:34:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Successfully detached device vdb from instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 from the live domain config.
Aug 08 23:34:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAJdNXFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:34:40 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[618f23cc-921c-4a6d-8a6d-a216f11778e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535df64-e92d-4960-a462-d34ac0d5b1e2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:40 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f2c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[423bfa7c-bd3b-4011-8975-5b43257ce425]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f679c0c5-7c5f-4b98-bffe-45bb75614fd9]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd615b-91d3-4219-9a24-3f9b2386eeec]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec5d0b-429b-46b9-aa11-64693b0e45e2]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1e37d9-4c11-4e72-868a-8bfc4afb1d3a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[08438a44-ef96-4edd-ad89-8f45d2475c9a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260]
Aug 08 23:34:40 user nova-compute[72405]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8, portal: 172.16.0.220,3260] successful.
Aug 08 23:34:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962aa7c4-12e6-44e8-a72c-074c3c3bf9f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786e021-02c2-4d0d-a4a1-2af2268becb8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] <== disconnect_volume: return (347ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:40 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'flavor' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ac8cd4de-8251-4bc2-a81b-984015f85704 tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-14717702-979c-48c2-a164-23e4f5fb449c req-0f53b205-5a64-4c65-8552-a1828438c474 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-14717702-979c-48c2-a164-23e4f5fb449c req-0f53b205-5a64-4c65-8552-a1828438c474 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-14717702-979c-48c2-a164-23e4f5fb449c req-0f53b205-5a64-4c65-8552-a1828438c474 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-14717702-979c-48c2-a164-23e4f5fb449c req-0f53b205-5a64-4c65-8552-a1828438c474 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-14717702-979c-48c2-a164-23e4f5fb449c req-0f53b205-5a64-4c65-8552-a1828438c474 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:34:41 user nova-compute[72405]: WARNING nova.compute.manager [req-14717702-979c-48c2-a164-23e4f5fb449c req-0f53b205-5a64-4c65-8552-a1828438c474 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state building and task_state spawning.
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537681.864361, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Resumed (Lifecycle Event)
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:34:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance spawned successfully.
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:34:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537681.867909, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Started (Lifecycle Event)
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:34:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:34:41 user nova-compute[72405]: INFO nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 08 23:34:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:42 user nova-compute[72405]: INFO nova.compute.manager [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Took 27.27 seconds to build instance.
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f0dbf2c7-fbbd-4dad-82a8-70db13cfa12e tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.434s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:34:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7068MB free_disk=25.06230926513672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 1aa97616-8607-4e4b-9264-fc3946be06ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8e0172ab-2223-492a-8dd5-985228661916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 022fd230-37ed-4a22-925c-64e9326c72fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance b410b764-3eab-40f1-9e27-81cefe78b0e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:34:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537671.4588857, befa7939-87a3-4258-9d44-dd986d9d5ea4 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:34:46 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] VM Stopped (Lifecycle Event)
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-changed-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Refreshing instance network info cache due to event network-changed-55e18cda-9a1e-47ed-b626-df5ad144df78. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] Acquiring lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] Acquired lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Refreshing network info cache for port 55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:34:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7f571e15-7bba-44bf-a26e-7a8d50485b42 None None] [instance: befa7939-87a3-4258-9d44-dd986d9d5ea4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG nova.network.neutron [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updated VIF entry in instance network info cache for port 55e18cda-9a1e-47ed-b626-df5ad144df78. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG nova.network.neutron [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updating instance_info_cache with network_info: [{"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cede9cec-4299-47bd-8fd5-ec82d8f19dec req-56ed58b2-98db-4571-aa9b-450b1a413640 service nova] Releasing lock "refresh_cache-ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'flavor' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:34:47 user nova-compute[72405]: INFO nova.compute.manager [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attaching volume 27999350-a690-49ea-a4e4-1b112a03a17a to /dev/vdb
Aug 08 23:34:47 user nova-compute[72405]: DEBUG os_brick.utils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ceadd-264b-4906-980a-04affe6450e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17b508b-e003-41ab-b4ba-09e5b8b96dd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1028b134-66d8-42c6-ab2c-d3007ede6550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2346866-3d78-4734-8807-9f42c2546080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:34:47 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:34:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[762a7a7c-91d4-456f-92b1-a610c395b126]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG os_brick.utils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:47 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updating existing volume attachment record: 4d4c5667-ecf6-428d-a669-92e35f6594a6 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:34:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:34:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:34:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgJYncbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:34:55 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:55 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:34:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:34:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:34:55 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:34:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425239c-bd6a-4017-a6b9-9454e8efc58b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:34:56 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c14fdd1-99b7-4207-9849-1cd0e7c7fb5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a] added
Aug 08 23:34:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[647fe25e-679d-43e1-86ad-2a85b49c025b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.106s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b05d1c-1ef0-4449-92dc-a304bc00b4a8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgJYncbm {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgJYncbm" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[17489786-a24f-429c-aa70-fac24f6769cf]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgJYncbm'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fbcd0e-128e-49e7-b0c4-c20584deb115]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2a8b8-e1ff-4a7a-9171-be1afa7ab017]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26c788-ec75-4bfe-8ed1-f3cd7fdbe53b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260]
Aug 08 23:34:56 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260] successful.
Aug 08 23:34:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a9c1f2-5579-4e04-8a21-6496a6bfe81f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[11797f1f-4ba1-41fa-91be-cf7c16c4af80]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:34:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:34:56 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:34:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.104s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3350458-1247-4f9b-beb8-c12f0b03499a]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:34:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgJYncbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] <== connect_volume: return (1540ms) {'type': 'block', 'scsi_wwn': '23865333433356238', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865333433356238', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'flavor' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:34:57 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:34:57 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:34:57 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:34:57 user nova-compute[72405]:   <serial>27999350-a690-49ea-a4e4-1b112a03a17a</serial>
Aug 08 23:34:57 user nova-compute[72405]: </disk>
Aug 08 23:34:57 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:34:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No VIF found with MAC fa:16:3e:e5:c7:7e, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:34:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e5af1c1c-b33e-4e24-bd29-b6217c94e084 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.453s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:34:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:34:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'flavor' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:01 user nova-compute[72405]: INFO nova.compute.manager [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attaching volume 69dad22f-8b14-4cff-827b-2a7c588fde15 to /dev/vdc
Aug 08 23:35:01 user nova-compute[72405]: DEBUG os_brick.utils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02ce5c-71df-44b1-9179-5db248cb92bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ddead-dd86-4350-9cf4-502ce0e216c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee8f424-37cf-4b9e-9042-b9ea5c4e0718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf8338-8ee8-454f-a753-f9d6335f88f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:01 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:35:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[299d7345-38dd-4587-b9a0-03318f837b18]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG os_brick.utils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:01 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updating existing volume attachment record: bd983619-1098-46a3-b5f6-f5f418ec940e {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:35:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-changed-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Refreshing instance network info cache due to event network-changed-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] Acquiring lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] Acquired lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Refreshing network info cache for port 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updated VIF entry in instance network info cache for port 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating instance_info_cache with network_info: [{"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b9f0aa07-3325-4e01-8969-bf7973a3d292 req-9f4fb631-ee2e-4fee-a1a8-fbb84af6915f service nova] Releasing lock "refresh_cache-1aa97616-8607-4e4b-9264-fc3946be06ba" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:08 user nova-compute[72405]: INFO nova.compute.manager [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attaching volume 601a7221-6799-4000-929b-683ec49961ac to /dev/vdb
Aug 08 23:35:09 user nova-compute[72405]: DEBUG os_brick.utils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa142ae7-2712-4cdc-b579-89c48cbbdcf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[862816d0-15f6-43f2-b0ec-fe28c21c3f38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b2a8f-2821-4e48-9ff4-313c973357f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[563c2ea2-ece1-4654-92a9-862b2a65d4cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:09 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:35:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c71945-47d6-47c4-a1be-83d01f691e82]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG os_brick.utils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:09 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating existing volume attachment record: 6132d2fc-f1d8-459a-8e9e-62343da05f04 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VacAngPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:10 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:10 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:10 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e6de6-5837-415d-a2ff-45a699536cbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:35:10 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[360974a5-9b09-4630-a400-62ecb03316de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15] added
Aug 08 23:35:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf84e9-6637-4b12-8e97-742094f884ea]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37e9ac0-359a-48da-bf9d-f14d8909ee6b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VacAngPJ {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VacAngPJ" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577dee2-e21d-4712-a133-9802e24f5036]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VacAngPJ'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b7b4b1-8bbc-4232-8230-2395be05b12b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc4492-cf36-4590-9e6a-7c9a80b5632b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd66b28-3e18-488b-92ec-05b177589822]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260]
Aug 08 23:35:10 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb13191-0667-450f-a2a9-1520456f7407]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3dfc04-8460-462f-b2e9-ec309f55a617]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:10 user nova-compute[72405]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 (non-flash)
Aug 08 23:35:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c989a84f-678e-4835-b015-95af6c5df268]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VacAngPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23263643539323038', 'path': '/dev/sdg'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263643539323038', 'path': '/dev/sdg'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'flavor' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:35:11 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:11 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:11 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:35:11 user nova-compute[72405]:   <serial>69dad22f-8b14-4cff-827b-2a7c588fde15</serial>
Aug 08 23:35:11 user nova-compute[72405]: </disk>
Aug 08 23:35:11 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:35:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] No VIF found with MAC fa:16:3e:e5:c7:7e, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:35:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8612dfd6-35d0-40b4-be94-4d367070e9bd tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.721s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:13 user nova-compute[72405]: INFO nova.compute.manager [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Detaching volume 69dad22f-8b14-4cff-827b-2a7c588fde15
Aug 08 23:35:13 user nova-compute[72405]: INFO nova.virt.block_device [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attempting to driver detach volume 69dad22f-8b14-4cff-827b-2a7c588fde15 from mountpoint /dev/vdc
Aug 08 23:35:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Attempting to detach device vdc from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:35:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:13 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:13 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:13 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:35:13 user nova-compute[72405]:   <serial>69dad22f-8b14-4cff-827b-2a7c588fde15</serial>
Aug 08 23:35:13 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 08 23:35:13 user nova-compute[72405]: </disk>
Aug 08 23:35:13 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:13 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Successfully detached device vdc from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the persistent domain config.
Aug 08 23:35:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:35:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:13 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:13 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:13 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:35:13 user nova-compute[72405]:   <serial>69dad22f-8b14-4cff-827b-2a7c588fde15</serial>
Aug 08 23:35:13 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 08 23:35:13 user nova-compute[72405]: </disk>
Aug 08 23:35:13 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537714.169853, ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:35:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Successfully detached device vdc from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the live domain config.
Aug 08 23:35:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VacAngPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:14 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[db59159e-9bb6-4c04-ac1f-d71dd101e6b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c17b58-e4ee-4659-88d5-958a42110973]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:14 user nova-compute[72405]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 (non-flash)
Aug 08 23:35:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7be0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15'): ({'sdg'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Removing single pathed devices sdg {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f937db-1522-4216-a7cd-b7c07a89f240]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be86399-e4f1-4d1e-87a8-72f3cbbd2b9a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Flushing IO for device /dev/sdg {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa64669-b19e-44b6-a108-70411e60e75b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cd0901-8b8e-42b0-a6f0-7285ab54067a]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9529de-ebe1-4a19-88cd-071ed66d82cc]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[450501cc-a591-4ef7-9ac4-3bd6ffb1b8f5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260]
Aug 08 23:35:14 user nova-compute[72405]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69dad22f-8b14-4cff-827b-2a7c588fde15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037add6-6e8a-4fa9-b424-90d6000bdef0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] <== disconnect_volume: return (322ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:35:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'flavor' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b962151d-1d22-4f47-b018-afabc6e9f9af tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOkEDAfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:17 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:17 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:17 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd91638f-c5a4-403e-95f0-c1bcc052c571]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:35:17 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[75514b87-e1da-4137-a3f8-1eb51175d04c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac] added
Aug 08 23:35:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f463f3-7c43-4473-949c-e8c1ca584e85]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1fe01-6721-450b-9c20-9fbff2bfbf1d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOkEDAfv {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOkEDAfv" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0cbca-cb48-468b-875b-7fad65562b15]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOkEDAfv'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b27ad-0275-4a0d-b0d2-5bb513b39d08]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b00a25e-9e8f-4d1b-bc77-a1d33b780f73]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:17 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8927e500-c03c-4f77-9d97-eabcd5c9baef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260]
Aug 08 23:35:18 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f286e2e7-f35c-483b-9b8b-0c115cb58c55]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[90389928-baeb-4ea4-b81c-3ac900365dc0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:18 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdff449-5c21-47a1-b663-b5998670ab1e]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOkEDAfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26165303031313833', 'path': '/dev/sdg'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165303031313833', 'path': '/dev/sdg'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:35:19 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:19 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:19 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:19 user nova-compute[72405]:   <serial>601a7221-6799-4000-929b-683ec49961ac</serial>
Aug 08 23:35:19 user nova-compute[72405]: </disk>
Aug 08 23:35:19 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No VIF found with MAC fa:16:3e:40:25:52, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:35:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bb342588-26da-4769-a37f-b40d9656b6fc tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.714s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:24 user nova-compute[72405]: INFO nova.compute.manager [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attaching volume 08fc638c-29f6-4dd6-b39a-cc40a584c72d to /dev/vdc
Aug 08 23:35:24 user nova-compute[72405]: DEBUG os_brick.utils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9984f3-19e0-4406-a093-5ce3400bd888]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dd2e06-06f1-4d01-9001-b50431e9d5fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c36910-04bd-4c88-9c90-eb342d82958a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[526940ea-7071-4f2c-ae73-87e547551b33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:24 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:35:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[59009697-5ac3-4fd4-bc7b-0eb0dc6489b5]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG os_brick.utils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:24 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating existing volume attachment record: bc6f7252-b15f-44fa-b217-df939ecca4fb {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:35:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:30 user nova-compute[72405]: INFO nova.compute.manager [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Terminating instance
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-0fd6650a-fa53-44a7-9e2c-136f59c32ba6 req-efe61ae9-f57c-4303-bdd6-ef076ded330d service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0fd6650a-fa53-44a7-9e2c-136f59c32ba6 req-efe61ae9-f57c-4303-bdd6-ef076ded330d service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0fd6650a-fa53-44a7-9e2c-136f59c32ba6 req-efe61ae9-f57c-4303-bdd6-ef076ded330d service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0fd6650a-fa53-44a7-9e2c-136f59c32ba6 req-efe61ae9-f57c-4303-bdd6-ef076ded330d service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-0fd6650a-fa53-44a7-9e2c-136f59c32ba6 req-efe61ae9-f57c-4303-bdd6-ef076ded330d service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-0fd6650a-fa53-44a7-9e2c-136f59c32ba6 req-efe61ae9-f57c-4303-bdd6-ef076ded330d service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-unplugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:30 user nova-compute[72405]: INFO nova.compute.manager [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Detaching volume 0f3fca48-1880-4f2c-9873-528ae41fdcc0
Aug 08 23:35:30 user nova-compute[72405]: INFO nova.virt.block_device [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Attempting to driver detach volume 0f3fca48-1880-4f2c-9873-528ae41fdcc0 from mountpoint /dev/vdb
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Attempting to detach device vdb from instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:30 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:30 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:30 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:30 user nova-compute[72405]:   <serial>0f3fca48-1880-4f2c-9873-528ae41fdcc0</serial>
Aug 08 23:35:30 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:35:30 user nova-compute[72405]: </disk>
Aug 08 23:35:30 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully detached device vdb from instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 from the persistent domain config.
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:30 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:30 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:30 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:30 user nova-compute[72405]:   <serial>0f3fca48-1880-4f2c-9873-528ae41fdcc0</serial>
Aug 08 23:35:30 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:35:30 user nova-compute[72405]: </disk>
Aug 08 23:35:30 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537731.1468606, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:35:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully detached device vdb from instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 from the live domain config.
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPzGmMkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:31 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Instance destroyed successfully.
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lazy-loading 'resources' on Instance uuid f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-452517066',display_name='tempest-ServerStableDeviceRescueTest-server-452517066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-452517066',id=18,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfb+9WmRPUuJID0aCtCuVWP3Y5xAGVKgUgc8vQE5Us4fml62cTBVbJ8SSWaqHZPlj6Uxq5guWwS0hwOkGccO0dH9ecgls3SF6jBVEpegRCE66dlBdrvcMqOKvzV/wvbHQ==',key_name='tempest-keypair-2083609225',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c875dc671b18444089e28d84beeb4bb4',ramdisk_id='',reservation_id='r-2xadwtvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-405578644',owner_user_name='tempest-ServerStableDeviceRescueTest-405578644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24b44561b1d9485b845bc9157be71736',uuid=f7fccdf2-d173-42c4-9c04-421e7dfe6ef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converting VIF {"id": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "address": "fa:16:3e:55:12:ff", "network": {"id": "fff2b92f-5a19-4648-8315-14df7214b9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-950132030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c875dc671b18444089e28d84beeb4bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f005eac-64", "ovs_interfaceid": "7f005eac-6485-491f-8fdf-c65a3a2d958e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_vif [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de18e1bb-5277-40ee-8b1a-d8f434ae5442]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f005eac-64, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:35:31 user nova-compute[72405]: INFO os_vif [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=7f005eac-6485-491f-8fdf-c65a3a2d958e,network=Network(fff2b92f-5a19-4648-8315-14df7214b9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f005eac-64')
Aug 08 23:35:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Deleting instance files /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0_del
Aug 08 23:35:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Deletion of /opt/stack/data/nova/instances/f7fccdf2-d173-42c4-9c04-421e7dfe6ef0_del complete
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65c3601-1020-446f-b386-94262bde5247]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:31 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67aa899-2979-4c08-81fb-82729ebb7cfd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[182ddc4a-982b-40a8-bb69-eed353090a9b]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: INFO nova.compute.manager [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec62f36-b3c5-4fe7-8615-c54488c111ea]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[888be16f-5b57-44d2-81e9-d4cca51332a2]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a88aae6-381b-4379-9681-ba275e2b627a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7607856-284d-40f4-bb52-c3c9401a96ff]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260]
Aug 08 23:35:31 user nova-compute[72405]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:31 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3fca48-1880-4f2c-9873-528ae41fdcc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21173ba-28e7-42c6-aa68-64215419db53]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== disconnect_volume: return (322ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'flavor' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1a91740-e639-4ba5-9b74-e7e79f6ed6dc tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-59343919-1161-4388-909c-2d8640233fd6 req-4e53cefa-c740-4e51-bc0c-f50eb25313e1 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-59343919-1161-4388-909c-2d8640233fd6 req-4e53cefa-c740-4e51-bc0c-f50eb25313e1 service nova] Acquiring lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-59343919-1161-4388-909c-2d8640233fd6 req-4e53cefa-c740-4e51-bc0c-f50eb25313e1 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-59343919-1161-4388-909c-2d8640233fd6 req-4e53cefa-c740-4e51-bc0c-f50eb25313e1 service nova] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-59343919-1161-4388-909c-2d8640233fd6 req-4e53cefa-c740-4e51-bc0c-f50eb25313e1 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] No waiting events found dispatching network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:35:32 user nova-compute[72405]: WARNING nova.compute.manager [req-59343919-1161-4388-909c-2d8640233fd6 req-4e53cefa-c740-4e51-bc0c-f50eb25313e1 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received unexpected event network-vif-plugged-7f005eac-6485-491f-8fdf-c65a3a2d958e for instance with vm_state active and task_state deleting.
Aug 08 23:35:32 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:32 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Took 1.48 seconds to deallocate network for instance.
Aug 08 23:35:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:33 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:35:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:35:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:33 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Deleted allocations for instance f7fccdf2-d173-42c4-9c04-421e7dfe6ef0
Aug 08 23:35:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5e0b42cb-990f-43b4-8eb1-d9ff1c6abe2a tempest-ServerStableDeviceRescueTest-405578644 tempest-ServerStableDeviceRescueTest-405578644-project-member] Lock "f7fccdf2-d173-42c4-9c04-421e7dfe6ef0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.358s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:33 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANYSsrFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:34 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:34 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:34 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d019ba1b-8384-4ff0-8e2c-c85a433a5b56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:35:34 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cff320-3ef9-41fa-904d-7dee7e46edf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d] added
Aug 08 23:35:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd6770-79dd-4c80-a399-5240db103504]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5269f10f-c4c0-40b0-9011-6901703ca0a8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANYSsrFR {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANYSsrFR" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff663ef4-8447-4bff-bbf6-2e650d12d103]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANYSsrFR'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[07daa645-8e64-443e-9f5b-87d20f1f90ec]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf3748-d357-47a4-9399-d60a6bf81aaa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6962dae7-8cb8-41c1-8114-4410b923d20b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260]
Aug 08 23:35:34 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8540dffa-99f4-41a7-91cf-9b50106bee07]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f727ca9-b606-43af-9c46-aa06a9847feb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)
Aug 08 23:35:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:34 user nova-compute[72405]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)
Aug 08 23:35:34 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6864d-b610-4df3-a044-82288c0705cb]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANYSsrFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Received event network-vif-deleted-7f005eac-6485-491f-8fdf-c65a3a2d958e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-changed-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Refreshing instance network info cache due to event network-changed-66c4a5b9-cee6-4852-bb58-79c44f919792. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] Acquiring lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] Acquired lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:35:34 user nova-compute[72405]: DEBUG nova.network.neutron [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Refreshing network info cache for port 66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updated VIF entry in instance network info cache for port 66c4a5b9-cee6-4852-bb58-79c44f919792. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updating instance_info_cache with network_info: [{"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ef289be6-5b98-44de-a601-85cdfb8fc539 req-34f23c5d-13d7-4b15-bf42-a91e4f923139 service nova] Releasing lock "refresh_cache-8e0172ab-2223-492a-8dd5-985228661916" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23964323431626164', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964323431626164', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:35:35 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:35 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:35 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:35:35 user nova-compute[72405]:   <serial>08fc638c-29f6-4dd6-b39a-cc40a584c72d</serial>
Aug 08 23:35:35 user nova-compute[72405]: </disk>
Aug 08 23:35:35 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] No VIF found with MAC fa:16:3e:40:25:52, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa4396c4-4265-4f6a-8a80-9fb10a1bcb78 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.581s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:36 user nova-compute[72405]: INFO nova.compute.manager [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Detaching volume 601a7221-6799-4000-929b-683ec49961ac
Aug 08 23:35:37 user nova-compute[72405]: INFO nova.virt.block_device [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attempting to driver detach volume 601a7221-6799-4000-929b-683ec49961ac from mountpoint /dev/vdb
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Attempting to detach device vdb from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:37 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:37 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:37 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:37 user nova-compute[72405]:   <serial>601a7221-6799-4000-929b-683ec49961ac</serial>
Aug 08 23:35:37 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:35:37 user nova-compute[72405]: </disk>
Aug 08 23:35:37 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:37 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully detached device vdb from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the persistent domain config.
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:37 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:37 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:37 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:37 user nova-compute[72405]:   <serial>601a7221-6799-4000-929b-683ec49961ac</serial>
Aug 08 23:35:37 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:35:37 user nova-compute[72405]: </disk>
Aug 08 23:35:37 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537737.5526795, 1aa97616-8607-4e4b-9264-fc3946be06ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:35:37 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully detached device vdb from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the live domain config.
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOkEDAfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:37 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc30f3-71f5-4655-94a1-9061f283e367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af79b7-0fba-48bb-956e-f81929a2e8c8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)
Aug 08 23:35:37 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac (non-flash)
Aug 08 23:35:37 user nova-compute[72405]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)
Aug 08 23:35:37 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb7820f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac'): ({'sdg'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Removing single pathed devices sdg {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24823900-ecee-4ac3-a99e-ed754c6c4e15]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3beee7-b570-4b28-872f-55c2048c026d]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flushing IO for device /dev/sdg {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90976f-980b-4256-b10c-a7e841006b4f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c4093-737c-4b80-8ce9-b08a864c0e9a]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[56886e2e-fcff-4c4d-88db-eed16466f6ff]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2fc988-cf07-4338-bb31-da29aabc055d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260]
Aug 08 23:35:37 user nova-compute[72405]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:37 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601a7221-6799-4000-929b-683ec49961ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6c054-3ada-4d7a-a7ac-d67eb0aecc74]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== disconnect_volume: return (329ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e1039e40-8586-4aba-b4c2-5b62ca49aca8 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.866s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:38 user nova-compute[72405]: INFO nova.compute.manager [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Attaching volume bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 to /dev/vdb
Aug 08 23:35:38 user nova-compute[72405]: DEBUG os_brick.utils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[064b3044-6b30-4a5c-a774-59855ea9be13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae8919-a747-4643-809a-f79ac07830c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[03955fb4-241a-4fa8-abb4-843f83094fd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f9404-fa5a-4e22-9851-2b4cb73e345f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:38 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:35:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6cd307-223c-46b9-98b9-8eb934ceb60a]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG os_brick.utils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:38 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updating existing volume attachment record: 8d2771d9-bed9-4c6d-9b47-d95f26abd8d6 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:39 user nova-compute[72405]: INFO nova.compute.manager [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Detaching volume 08fc638c-29f6-4dd6-b39a-cc40a584c72d
Aug 08 23:35:39 user nova-compute[72405]: INFO nova.virt.block_device [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Attempting to driver detach volume 08fc638c-29f6-4dd6-b39a-cc40a584c72d from mountpoint /dev/vdc
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Attempting to detach device vdc from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:39 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:39 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:39 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:35:39 user nova-compute[72405]:   <serial>08fc638c-29f6-4dd6-b39a-cc40a584c72d</serial>
Aug 08 23:35:39 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 08 23:35:39 user nova-compute[72405]: </disk>
Aug 08 23:35:39 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully detached device vdc from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the persistent domain config.
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:39 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:39 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:39 user nova-compute[72405]:   <target dev="vdc" bus="virtio"/>
Aug 08 23:35:39 user nova-compute[72405]:   <serial>08fc638c-29f6-4dd6-b39a-cc40a584c72d</serial>
Aug 08 23:35:39 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 08 23:35:39 user nova-compute[72405]: </disk>
Aug 08 23:35:39 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537739.9828317, 1aa97616-8607-4e4b-9264-fc3946be06ba => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:35:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully detached device vdc from instance 1aa97616-8607-4e4b-9264-fc3946be06ba from the live domain config.
Aug 08 23:35:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANYSsrFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:39 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fc35b8-146f-4d50-92c8-84fda1743cff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8d0a9-5921-433a-9da4-194eb0a1907f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)
Aug 08 23:35:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:40 user nova-compute[72405]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d (non-flash)
Aug 08 23:35:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781a3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b58e179-a8bf-4ad3-b57b-9523812ba5b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[53420156-6cc1-43d7-981d-f8ca412268cb]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939c2c1-6ae0-4828-8ce2-005f503361a9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cbbb77-882d-42b9-8fc7-c356af648a95]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f55761-3e6c-446a-8263-6990dd86252f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1892fb-8a0a-4f41-b1e6-b58bcb0df544]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260]
Aug 08 23:35:40 user nova-compute[72405]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fc638c-29f6-4dd6-b39a-cc40a584c72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5d697-ccb9-4774-bbeb-7cc62cc97a45]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] <== disconnect_volume: return (330ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'flavor' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-88460301-56c0-43f6-9462-59d0e7bae5c3 tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-changed-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Refreshing instance network info cache due to event network-changed-ff8c538f-c133-4e83-b563-03067ff812f7. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] Acquiring lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] Acquired lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Refreshing network info cache for port ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'flavor' on Instance uuid 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Ignoring supplied device name: /dev/vdb
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.162s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:42 user nova-compute[72405]: INFO nova.compute.manager [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Attaching volume 634ac31f-8052-45b7-ae48-b5a3981084fa to /dev/vdb
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:42 user nova-compute[72405]: INFO nova.compute.manager [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Terminating instance
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_brick.utils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.network.neutron [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updated VIF entry in instance network info cache for port ff8c538f-c133-4e83-b563-03067ff812f7. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.network.neutron [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updating instance_info_cache with network_info: [{"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5c821-3ccd-4d84-80e7-d2d93daec2bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-97c1ba6d-1eab-4732-be35-3fbbc2c31edb req-5c116357-74f1-43ef-9cc8-39a7eb3b4e67 service nova] Releasing lock "refresh_cache-022fd230-37ed-4a22-925c-64e9326c72fd" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7aa83-8fec-413f-bff1-adade732004e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921a93d-7f8b-4c88-96b6-a8a4a63e9eae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0464a-9d67-46fa-9703-60348a445680]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:35:42 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f79f80-ac80-4560-a601-a1a705c80873]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_brick.utils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updating existing volume attachment record: b763daff-2854-40de-839c-aae4c6b34cff {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6d08f88-4245-4e62-ac9e-0a70511bd859 req-bfc3aadc-7f74-4814-9e62-d49a223dda4c service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-vif-unplugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6d08f88-4245-4e62-ac9e-0a70511bd859 req-bfc3aadc-7f74-4814-9e62-d49a223dda4c service nova] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6d08f88-4245-4e62-ac9e-0a70511bd859 req-bfc3aadc-7f74-4814-9e62-d49a223dda4c service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6d08f88-4245-4e62-ac9e-0a70511bd859 req-bfc3aadc-7f74-4814-9e62-d49a223dda4c service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6d08f88-4245-4e62-ac9e-0a70511bd859 req-bfc3aadc-7f74-4814-9e62-d49a223dda4c service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] No waiting events found dispatching network-vif-unplugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6d08f88-4245-4e62-ac9e-0a70511bd859 req-bfc3aadc-7f74-4814-9e62-d49a223dda4c service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-vif-unplugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Instance destroyed successfully.
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lazy-loading 'resources' on Instance uuid 1aa97616-8607-4e4b-9264-fc3946be06ba {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2114968723',display_name='tempest-AttachVolumeTestJSON-server-2114968723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2114968723',id=28,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJECbKEi7avTHBNfy+W9Zi6McF3LliK2DC0FMZd7ItKFh5psdYpoa9e48NzgPjesraSct7hmxF7n9zopCOJIJccxcvVgVgeFqgOaaV4UwAdRkePK0r41ZDGQrz9jadSzg==',key_name='tempest-keypair-215023531',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:33:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ebca86ade54e1f9805255b64901be8',ramdisk_id='',reservation_id='r-lsptg72e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1838616528',owner_user_name='tempest-AttachVolumeTestJSON-1838616528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e934b55e46634b7097bb144b74ac5954',uuid=1aa97616-8607-4e4b-9264-fc3946be06ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converting VIF {"id": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "address": "fa:16:3e:40:25:52", "network": {"id": "ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1116320969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ebca86ade54e1f9805255b64901be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7af3ac-cb", "ovs_interfaceid": "0a7af3ac-cb0a-4e50-a04d-2c84a92371b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG os_vif [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a7af3ac-cb, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:35:42 user nova-compute[72405]: INFO os_vif [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:25:52,bridge_name='br-int',has_traffic_filtering=True,id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6,network=Network(ff8f7c7f-e90a-493d-a23f-1692dcbcf9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7af3ac-cb')
Aug 08 23:35:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Deleting instance files /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba_del
Aug 08 23:35:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Deletion of /opt/stack/data/nova/instances/1aa97616-8607-4e4b-9264-fc3946be06ba_del complete
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:43 user nova-compute[72405]: INFO nova.compute.manager [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:43 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid '1aa97616-8607-4e4b-9264-fc3946be06ba' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid '1aa97616-8607-4e4b-9264-fc3946be06ba' (instance-0000001c)
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:43 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Took 0.86 seconds to deallocate network for instance.
Aug 08 23:35:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-08f6d77e-0148-40e4-a91a-6d47db328b83 req-9841c6a0-0ea9-4779-b518-a5fc8670c374 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-vif-deleted-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:43 user nova-compute[72405]: INFO nova.compute.manager [req-08f6d77e-0148-40e4-a91a-6d47db328b83 req-9841c6a0-0ea9-4779-b518-a5fc8670c374 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Neutron deleted interface 0a7af3ac-cb0a-4e50-a04d-2c84a92371b6; detaching it from the instance and deleting it from the info cache
Aug 08 23:35:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-08f6d77e-0148-40e4-a91a-6d47db328b83 req-9841c6a0-0ea9-4779-b518-a5fc8670c374 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-08f6d77e-0148-40e4-a91a-6d47db328b83 req-9841c6a0-0ea9-4779-b518-a5fc8670c374 service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Detach interface failed, port_id=0a7af3ac-cb0a-4e50-a04d-2c84a92371b6, reason: Instance 1aa97616-8607-4e4b-9264-fc3946be06ba could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-9082f05e-8074-4e1c-b416-7731c572325e req-5b869ceb-d7e9-46f7-8836-2efecbd0bf8b service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received event network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9082f05e-8074-4e1c-b416-7731c572325e req-5b869ceb-d7e9-46f7-8836-2efecbd0bf8b service nova] Acquiring lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9082f05e-8074-4e1c-b416-7731c572325e req-5b869ceb-d7e9-46f7-8836-2efecbd0bf8b service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9082f05e-8074-4e1c-b416-7731c572325e req-5b869ceb-d7e9-46f7-8836-2efecbd0bf8b service nova] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-9082f05e-8074-4e1c-b416-7731c572325e req-5b869ceb-d7e9-46f7-8836-2efecbd0bf8b service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] No waiting events found dispatching network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:35:44 user nova-compute[72405]: WARNING nova.compute.manager [req-9082f05e-8074-4e1c-b416-7731c572325e req-5b869ceb-d7e9-46f7-8836-2efecbd0bf8b service nova] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Received unexpected event network-vif-plugged-0a7af3ac-cb0a-4e50-a04d-2c84a92371b6 for instance with vm_state deleted and task_state None.
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:35:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:35:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:35:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7156MB free_disk=25.183441162109375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.974s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.020s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:45 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Deleted allocations for instance 1aa97616-8607-4e4b-9264-fc3946be06ba
Aug 08 23:35:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dd07c2c7-ceb3-4465-aa22-d321e49f66da tempest-AttachVolumeTestJSON-1838616528 tempest-AttachVolumeTestJSON-1838616528-project-member] Lock "1aa97616-8607-4e4b-9264-fc3946be06ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.026s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8e0172ab-2223-492a-8dd5-985228661916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 022fd230-37ed-4a22-925c-64e9326c72fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance b410b764-3eab-40f1-9e27-81cefe78b0e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:35:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:46 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537731.161657, f7fccdf2-d173-42c4-9c04-421e7dfe6ef0 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:35:46 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] VM Stopped (Lifecycle Event)
Aug 08 23:35:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b9e3ed77-f0ee-438b-a1a2-b8de29dbda87 None None] [instance: f7fccdf2-d173-42c4-9c04-421e7dfe6ef0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:35:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbKsMZhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:48 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:48 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:48 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3777d6f2-5a27-4742-a013-2c63d97e24c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:35:48 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559a5d9-42b6-4358-901d-872d4902f59e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0] added
Aug 08 23:35:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[46361a67-5e4b-43bd-9290-eed147c7daad]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b20a34a-3f16-44c1-9bdc-02d6a2c65fe1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbKsMZhI {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbKsMZhI" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0a3e0-68f8-44f8-816c-dc62b91b439d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tbKsMZhI'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffef118-07fd-4f78-9cba-c11a9deab7b9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bceef55-75a3-4e16-a033-db6c833cb6a2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e972843-dd98-4748-9e61-e556a9de6a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260]
Aug 08 23:35:48 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b79cab3-f238-4a9a-879d-de2168e8f65a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7089d178-da21-46a3-ab98-dedc90a8fe28]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:48 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c406cd6-ccc1-4732-8543-9cf669744dbb]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbKsMZhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:35:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23834326563643938', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834326563643938', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:35:49 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:35:49 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:49 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:49 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:49 user nova-compute[72405]:   <serial>bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0</serial>
Aug 08 23:35:49 user nova-compute[72405]: </disk>
Aug 08 23:35:49 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:35:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] No VIF found with MAC fa:16:3e:8a:d7:4e, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:35:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd47147a-eea5-44ed-be16-8c02e94261d8 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.606s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:35:51 user nova-compute[72405]: INFO nova.compute.manager [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Detaching volume bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0
Aug 08 23:35:51 user nova-compute[72405]: INFO nova.virt.block_device [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Attempting to driver detach volume bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 from mountpoint /dev/vdb
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Attempting to detach device vdb from instance 8e0172ab-2223-492a-8dd5-985228661916 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:51 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:51 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:51 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:51 user nova-compute[72405]:   <serial>bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0</serial>
Aug 08 23:35:51 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:35:51 user nova-compute[72405]: </disk>
Aug 08 23:35:51 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully detached device vdb from instance 8e0172ab-2223-492a-8dd5-985228661916 from the persistent domain config.
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e0172ab-2223-492a-8dd5-985228661916 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:35:51 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:51 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:35:51 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:51 user nova-compute[72405]:   <serial>bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0</serial>
Aug 08 23:35:51 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:35:51 user nova-compute[72405]: </disk>
Aug 08 23:35:51 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxgJcHME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:51 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:51 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:51 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de308734-86cc-4a3a-a219-db4a27054fc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:35:51 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d179c6-be5a-4f04-821c-cb65924321a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa] added
Aug 08 23:35:51 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d15992-32f4-403f-b7e3-97a1b3cc8031]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[67159b40-06c4-40ae-b7da-dc6ee9f8b270]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxgJcHME {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxgJcHME" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e87d957-2a30-4950-83da-4c108d39449a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zxgJcHME'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537751.6320822, 8e0172ab-2223-492a-8dd5-985228661916 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:35:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully detached device vdb from instance 8e0172ab-2223-492a-8dd5-985228661916 from the live domain config.
Aug 08 23:35:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbKsMZhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:35:51 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9fb77f-d902-435d-830a-eca27db9ec8e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473361f-c33e-4646-9832-2ab15b1a0e14]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b186dc-ef7a-4e05-b82e-381c4a35324d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260]
Aug 08 23:35:51 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:51 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4e4ec-9566-46e5-b189-707492742c94]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6887fc-dd05-47fa-b79e-a7439517502d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:35:51 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:51 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:35:51 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f63131-980f-4796-abde-262c68b9264b]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:51 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxgJcHME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23363386264346565', 'path': '/dev/sdg'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363386264346565', 'path': '/dev/sdg'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.203s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG nova.objects.instance [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'flavor' on Instance uuid 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bdb1df-f6da-4172-8380-b5c0f47ffc97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:35:52 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:35:52 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:35:52 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:35:52 user nova-compute[72405]:   <serial>634ac31f-8052-45b7-ae48-b5a3981084fa</serial>
Aug 08 23:35:52 user nova-compute[72405]: </disk>
Aug 08 23:35:52 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb4602-2763-4e8b-a169-aee5468be0e3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:35:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 (non-flash)
Aug 08 23:35:52 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:35:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f1a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[954147cf-1b87-49df-94cc-8f5483bfa94a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aed782-dd1f-4d8e-94c1-ff9a854c17e7]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96c494-f394-4f5f-a4c2-4992c0006114]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:35:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[40abd455-56b0-450b-a778-ef6a642acdf3]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0544065c-d904-4826-8104-55b57cff9f0e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ee3d9-40c8-4439-88a8-9bfa28bcba41]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260]
Aug 08 23:35:53 user nova-compute[72405]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0, portal: 172.16.0.220,3260] successful.
Aug 08 23:35:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f3a83-e2e2-4509-b0b6-3c2cba4418a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef3d7e-f814-4c15-8990-47c54b6c8457]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] <== disconnect_volume: return (1509ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] No VIF found with MAC fa:16:3e:e1:a7:d5, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-735c0ba1-9ad4-4708-ade8-d65e41b3aaf6 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.345s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'flavor' on Instance uuid 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:35:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-aaba1f67-b6c1-4017-9d83-e195b6c779c4 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.877s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:35:57 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537742.895825, 1aa97616-8607-4e4b-9264-fc3946be06ba => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:35:57 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] VM Stopped (Lifecycle Event)
Aug 08 23:35:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e7ac6fec-c521-48a9-a022-8c4a908fdf1d None None] [instance: 1aa97616-8607-4e4b-9264-fc3946be06ba] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:35:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:35:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:01 user nova-compute[72405]: INFO nova.compute.manager [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Terminating instance
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-4f5f9bd4-8d8f-4bdf-ad85-470d463dde4d req-58dc5640-d6e5-40c4-9f0f-5194cf41afce service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4f5f9bd4-8d8f-4bdf-ad85-470d463dde4d req-58dc5640-d6e5-40c4-9f0f-5194cf41afce service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4f5f9bd4-8d8f-4bdf-ad85-470d463dde4d req-58dc5640-d6e5-40c4-9f0f-5194cf41afce service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4f5f9bd4-8d8f-4bdf-ad85-470d463dde4d req-58dc5640-d6e5-40c4-9f0f-5194cf41afce service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-4f5f9bd4-8d8f-4bdf-ad85-470d463dde4d req-58dc5640-d6e5-40c4-9f0f-5194cf41afce service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-4f5f9bd4-8d8f-4bdf-ad85-470d463dde4d req-58dc5640-d6e5-40c4-9f0f-5194cf41afce service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Instance destroyed successfully.
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lazy-loading 'resources' on Instance uuid 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1330613417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1330613417',id=24,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZrgB0t8FyEc9XDJAEVKchd2UHxZI2ndPwoMOm/H4NoEIISPQHebEz1f8EBd0SrxcatAlMw7TVzErTi2xbmATOuOsUFaBACHBYZ8KKF/5KEAQ8mhYCsUoodnumvFPn70g==',key_name='tempest-keypair-779216247',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:34:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f6dc799f1b4698b15a3ea91c8dbea9',ramdisk_id='',reservation_id='r-gjwgg0im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1695202964',owner_user_name='tempest-AttachVolumeShelveTestJSON-1695202964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb25719ffe4c467e8afc3f6b8fe4d712',uuid=3ff81abc-acf0-4d6e-b88b-3db62c9f9080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converting VIF {"id": "418e6ca5-f552-4992-b7e5-26daea416207", "address": "fa:16:3e:6c:3b:64", "network": {"id": "aa07b288-68e5-4ea0-bcad-7998a86b7bd6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-489878866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f6dc799f1b4698b15a3ea91c8dbea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap418e6ca5-f5", "ovs_interfaceid": "418e6ca5-f552-4992-b7e5-26daea416207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG os_vif [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap418e6ca5-f5, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:02 user nova-compute[72405]: INFO os_vif [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3b:64,bridge_name='br-int',has_traffic_filtering=True,id=418e6ca5-f552-4992-b7e5-26daea416207,network=Network(aa07b288-68e5-4ea0-bcad-7998a86b7bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap418e6ca5-f5')
Aug 08 23:36:02 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Deleting instance files /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080_del
Aug 08 23:36:02 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Deletion of /opt/stack/data/nova/instances/3ff81abc-acf0-4d6e-b88b-3db62c9f9080_del complete
Aug 08 23:36:02 user nova-compute[72405]: INFO nova.compute.manager [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 08 23:36:02 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:03 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Took 1.26 seconds to deallocate network for instance.
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-9e4846e4-456e-475a-8f8b-4d5eefa6dc70 req-ce85925c-35b4-4bbe-85aa-d0f1c506f9bd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-deleted-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:03 user nova-compute[72405]: INFO nova.compute.manager [req-9e4846e4-456e-475a-8f8b-4d5eefa6dc70 req-ce85925c-35b4-4bbe-85aa-d0f1c506f9bd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Neutron deleted interface 418e6ca5-f552-4992-b7e5-26daea416207; detaching it from the instance and deleting it from the info cache
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.network.neutron [req-9e4846e4-456e-475a-8f8b-4d5eefa6dc70 req-ce85925c-35b4-4bbe-85aa-d0f1c506f9bd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-9e4846e4-456e-475a-8f8b-4d5eefa6dc70 req-ce85925c-35b4-4bbe-85aa-d0f1c506f9bd service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Detach interface failed, port_id=418e6ca5-f552-4992-b7e5-26daea416207, reason: Instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:03 user nova-compute[72405]: WARNING nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state deleted and task_state None.
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:03 user nova-compute[72405]: WARNING nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state deleted and task_state None.
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:03 user nova-compute[72405]: WARNING nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state deleted and task_state None.
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:03 user nova-compute[72405]: WARNING nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-unplugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state deleted and task_state None.
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Acquiring lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] No waiting events found dispatching network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:03 user nova-compute[72405]: WARNING nova.compute.manager [req-49487a1c-5496-404b-b9a8-4317f515a3fe req-1875910b-59fc-45a5-a586-2ea1b475ab9a service nova] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Received unexpected event network-vif-plugged-418e6ca5-f552-4992-b7e5-26daea416207 for instance with vm_state deleted and task_state None.
Aug 08 23:36:03 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:03 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Deleted allocations for instance 3ff81abc-acf0-4d6e-b88b-3db62c9f9080
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84bc2c33-34ed-42b8-b278-ce4efa0d4293 tempest-AttachVolumeShelveTestJSON-1695202964 tempest-AttachVolumeShelveTestJSON-1695202964-project-member] Lock "3ff81abc-acf0-4d6e-b88b-3db62c9f9080" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:04 user nova-compute[72405]: INFO nova.compute.manager [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Detaching volume 27999350-a690-49ea-a4e4-1b112a03a17a
Aug 08 23:36:04 user nova-compute[72405]: INFO nova.virt.block_device [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Attempting to driver detach volume 27999350-a690-49ea-a4e4-1b112a03a17a from mountpoint /dev/vdb
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Attempting to detach device vdb from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:36:04 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:36:04 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:36:04 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:36:04 user nova-compute[72405]:   <serial>27999350-a690-49ea-a4e4-1b112a03a17a</serial>
Aug 08 23:36:04 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:36:04 user nova-compute[72405]: </disk>
Aug 08 23:36:04 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:36:04 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Successfully detached device vdb from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the persistent domain config.
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:36:04 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:36:04 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:36:04 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:36:04 user nova-compute[72405]:   <serial>27999350-a690-49ea-a4e4-1b112a03a17a</serial>
Aug 08 23:36:04 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:36:04 user nova-compute[72405]: </disk>
Aug 08 23:36:04 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:36:04 user nova-compute[72405]: INFO nova.compute.manager [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Rescuing
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537764.7318647, ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:36:04 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Successfully detached device vdb from instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf from the live domain config.
Aug 08 23:36:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgJYncbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:36:04 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bf4882-ef71-4359-972c-928c9ddd7024]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc6e4a-47e0-4738-bc73-0c8e09c09804]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:36:04 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a (non-flash)
Aug 08 23:36:04 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:36:04 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781a1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2dba6f-506f-4a7e-82db-98157449c511]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb80a4-431a-43a3-8fce-33940b78af84]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686bfd3-e3f9-43e1-9ae8-d4c87248c21a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b2703-a2b0-4b83-9695-16fb153a2420]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82877aa-31da-40f5-ba51-cf24dc889d05]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b55b10-7c70-417a-ae64-150eaece2cd8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260]
Aug 08 23:36:05 user nova-compute[72405]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a, portal: 172.16.0.220,3260] successful.
Aug 08 23:36:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27999350-a690-49ea-a4e4-1b112a03a17a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afb8073-8a75-4618-9f95-ac6ffc9b7362]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] <== disconnect_volume: return (307ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating instance_info_cache with network_info: [{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'flavor' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-34703d48-753c-4361-96f3-f6f1000b2199 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:05 user nova-compute[72405]: WARNING nova.compute.manager [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state active and task_state rescuing.
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:05 user nova-compute[72405]: WARNING nova.compute.manager [req-2490e1f6-7c0f-484d-b77e-464f05aef48b req-7fec91a7-1526-4a00-8f79-8501663e9729 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state active and task_state rescuing.
Aug 08 23:36:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance destroyed successfully.
Aug 08 23:36:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Attempting a stable device rescue
Aug 08 23:36:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72405) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 08 23:36:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:36:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Creating image(s)
Aug 08 23:36:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "/opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "/opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:06 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'trusted_certs' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG nova.virt.images [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] 1e619334-4ae4-4e80-b244-cb2e9e5c7492 was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.part /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.part /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.converted" returned: 0 in 0.535s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72 --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72,backing_fmt=raw /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72,backing_fmt=raw /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue" returned: 0 in 0.049s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'migration_context' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Start _get_guest_xml network_info=[{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "vif_mac": "fa:16:3e:11:0a:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1e619334-4ae4-4e80-b244-cb2e9e5c7492', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d0a3e2a-3fbf-4b6e-90eb-e19cce2569d6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'b410b764-3eab-40f1-9e27-81cefe78b0e3', 'attached_at': '', 'detached_at': '', 'volume_id': '0d20d2dc-a7a5-4a7d-9915-b4981a666d92', 'serial': '0d20d2dc-a7a5-4a7d-9915-b4981a666d92'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'resources' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'numa_topology' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'vcpu_model' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:36:08 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:36:08 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:36:08 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49baa9-18ec-4b6b-80b7-92123941504d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yUwCPYgc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 08 23:36:08 user nova-compute[72405]: node.name = iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92
Aug 08 23:36:08 user nova-compute[72405]: node.tpgt = -1
Aug 08 23:36:08 user nova-compute[72405]: node.startup = automatic
Aug 08 23:36:08 user nova-compute[72405]: node.leading_login = No
Aug 08 23:36:08 user nova-compute[72405]: iface.iscsi_ifacename = default
Aug 08 23:36:08 user nova-compute[72405]: iface.net_ifacename = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.ipaddress = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.prefix_len = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.hwaddress = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.transport_name = tcp
Aug 08 23:36:08 user nova-compute[72405]: iface.initiatorname = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.vlan_id = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.vlan_priority = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.vlan_state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.iface_num = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.mtu = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.port = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.bootproto = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.subnet_mask = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.gateway = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_alt_client_id_state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_alt_client_id = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_dns = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_learn_iqn = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_req_vendor_id_state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_vendor_id_state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_vendor_id = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.dhcp_slp_da = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.fragmentation = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.gratuitous_arp = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.incoming_forwarding = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.tos_state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.tos = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.ttl = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.delayed_ack = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.tcp_nagle = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.tcp_wsf_state = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.tcp_wsf = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.tcp_timer_scale = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.tcp_timestamp = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.redirect = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.def_task_mgmt_timeout = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.header_digest = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.data_digest = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.immediate_data = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.initial_r2t = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.data_seq_inorder = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.data_pdu_inorder = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.erl = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.max_receive_data_len = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.first_burst_len = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.max_outstanding_r2t = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.max_burst_len = 0
Aug 08 23:36:08 user nova-compute[72405]: iface.chap_auth = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.bidi_chap = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.strict_login_compliance = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.discovery_auth = <empty>
Aug 08 23:36:08 user nova-compute[72405]: iface.discovery_logout = <empty>
Aug 08 23:36:08 user nova-compute[72405]: node.discovery_address = <empty>
Aug 08 23:36:08 user nova-compute[72405]: node.discovery_port = 0
Aug 08 23:36:08 user nova-compute[72405]: node.discovery_type = static
Aug 08 23:36:08 user nova-compute[72405]: node.session.initial_cmdsn = 0
Aug 08 23:36:08 user nova-compute[72405]: node.session.initial_login_retry_max = 8
Aug 08 23:36:08 user nova-compute[72405]: node.session.xmit_thread_priority = -20
Aug 08 23:36:08 user nova-compute[72405]: node.session.cmds_max = 128
Aug 08 23:36:08 user nova-compute[72405]: node.session.queue_depth = 32
Aug 08 23:36:08 user nova-compute[72405]: node.session.nr_sessions = 1
Aug 08 23:36:08 user nova-compute[72405]: node.session.auth.authmethod = CHAP
Aug 08 23:36:08 user nova-compute[72405]: node.session.auth.username = yUwCPYgc
Aug 08 23:36:08 user nova-compute[72405]: node.session.auth.password = ***
Aug 08 23:36:08 user nova-compute[72405]: node.session.auth.username_in = <empty>
Aug 08 23:36:08 user nova-compute[72405]: node.session.auth.password_in = <empty>
Aug 08 23:36:08 user nova-compute[72405]: node.session.auth.chap_algs = MD5
Aug 08 23:36:08 user nova-compute[72405]: node.session.timeo.replacement_timeout = 120
Aug 08 23:36:08 user nova-compute[72405]: node.session.err_timeo.abort_timeout = 15
Aug 08 23:36:08 user nova-compute[72405]: node.session.err_timeo.lu_reset_timeout = 30
Aug 08 23:36:08 user nova-compute[72405]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 08 23:36:08 user nova-compute[72405]: node.session.err_timeo.host_reset_timeout = 60
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.FastAbort = Yes
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.InitialR2T = No
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.ImmediateData = Yes
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.FirstBurstLength = 262144
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.MaxBurstLength = 16776192
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.DefaultTime2Retain = 0
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.DefaultTime2Wait = 2
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.MaxConnections = 1
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 08 23:36:08 user nova-compute[72405]: node.session.iscsi.ERL = 0
Aug 08 23:36:08 user nova-compute[72405]: node.session.scan = manual
Aug 08 23:36:08 user nova-compute[72405]: node.session.reopen_max = 0
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].address = 172.16.0.220
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].port = 3260
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].startup = manual
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].tcp.window_size = 524288
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].tcp.type_of_service = 0
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].timeo.logout_timeout = 15
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].timeo.login_timeout = 15
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].timeo.auth_timeout = 45
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].timeo.noop_out_interval = 5
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].timeo.noop_out_timeout = 5
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].iscsi.HeaderDigest = None
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].iscsi.DataDigest = None
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].iscsi.IFMarker = No
Aug 08 23:36:08 user nova-compute[72405]: node.conn[0].iscsi.OFMarker = No
Aug 08 23:36:08 user nova-compute[72405]: # END RECORD
Aug 08 23:36:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55e107-a460-4226-bca1-4464b760b3a7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f3d31-ad5a-4729-a753-4794f2f5ad2d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUwCPYgc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUwCPYgc" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f4c30b-de46-4750-9c68-f383d1d65962]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yUwCPYgc'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[405c9f69-bdf2-4409-b4c6-fe75908ed62c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79e317-3a6f-4ce6-83ae-590619b3ad78]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:08 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:08 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:08 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:36:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:08 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:08 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:08 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:36:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] HCTL ('37', '0', '0', 0) found on session 34 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d77e4d-8f1b-4876-9eee-cd08ea38dcae]: (4, ('0 0 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Searching for a device in session 34 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '26564653464323561', 'path': '/dev/sdf'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564653464323561', 'path': '/dev/sdf'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-859653112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-859653112',id=31,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-9o558hjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:34:42Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=b410b764-3eab-40f1-9e27-81cefe78b0e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "vif_mac": "fa:16:3e:11:0a:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "vif_mac": "fa:16:3e:11:0a:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'pci_devices' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:36:08 user nova-compute[72405]:   <uuid>b410b764-3eab-40f1-9e27-81cefe78b0e3</uuid>
Aug 08 23:36:08 user nova-compute[72405]:   <name>instance-0000001f</name>
Aug 08 23:36:08 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:36:08 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:36:08 user nova-compute[72405]:   <metadata>
Aug 08 23:36:08 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:36:08 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:36:08 user nova-compute[72405]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-859653112</nova:name>
Aug 08 23:36:08 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:36:08</nova:creationTime>
Aug 08 23:36:08 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:36:08 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:36:08 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:36:08 user nova-compute[72405]:       <nova:owner>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:user uuid="d9b5279220af4cc4a364014419168ae8">tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member</nova:user>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:project uuid="1bf26de781ef4462914d7f32168b3192">tempest-ServerBootFromVolumeStableRescueTest-1549652719</nova:project>
Aug 08 23:36:08 user nova-compute[72405]:       </nova:owner>
Aug 08 23:36:08 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:36:08 user nova-compute[72405]:       <nova:ports>
Aug 08 23:36:08 user nova-compute[72405]:         <nova:port uuid="607ff757-39b7-4fab-b733-a5866fa0709c">
Aug 08 23:36:08 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 08 23:36:08 user nova-compute[72405]:         </nova:port>
Aug 08 23:36:08 user nova-compute[72405]:       </nova:ports>
Aug 08 23:36:08 user nova-compute[72405]:     </nova:instance>
Aug 08 23:36:08 user nova-compute[72405]:   </metadata>
Aug 08 23:36:08 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:36:08 user nova-compute[72405]:     <system>
Aug 08 23:36:08 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:36:08 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:36:08 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:36:08 user nova-compute[72405]:       <entry name="serial">b410b764-3eab-40f1-9e27-81cefe78b0e3</entry>
Aug 08 23:36:08 user nova-compute[72405]:       <entry name="uuid">b410b764-3eab-40f1-9e27-81cefe78b0e3</entry>
Aug 08 23:36:08 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:36:08 user nova-compute[72405]:     </system>
Aug 08 23:36:08 user nova-compute[72405]:   </sysinfo>
Aug 08 23:36:08 user nova-compute[72405]:   <os>
Aug 08 23:36:08 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:36:08 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:36:08 user nova-compute[72405]:   </os>
Aug 08 23:36:08 user nova-compute[72405]:   <features>
Aug 08 23:36:08 user nova-compute[72405]:     <acpi/>
Aug 08 23:36:08 user nova-compute[72405]:     <apic/>
Aug 08 23:36:08 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:36:08 user nova-compute[72405]:   </features>
Aug 08 23:36:08 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:36:08 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:36:08 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:36:08 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:36:08 user nova-compute[72405]:   </clock>
Aug 08 23:36:08 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:36:08 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:36:08 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:36:08 user nova-compute[72405]:   </cpu>
Aug 08 23:36:08 user nova-compute[72405]:   <devices>
Aug 08 23:36:08 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:36:08 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:36:08 user nova-compute[72405]:       <source dev="/dev/sdf"/>
Aug 08 23:36:08 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:36:08 user nova-compute[72405]:       <serial>0d20d2dc-a7a5-4a7d-9915-b4981a666d92</serial>
Aug 08 23:36:08 user nova-compute[72405]:     </disk>
Aug 08 23:36:08 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:36:08 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:36:08 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue"/>
Aug 08 23:36:08 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:36:08 user nova-compute[72405]:       <boot order="1"/>
Aug 08 23:36:08 user nova-compute[72405]:     </disk>
Aug 08 23:36:08 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:36:08 user nova-compute[72405]:       <mac address="fa:16:3e:11:0a:0b"/>
Aug 08 23:36:08 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:36:08 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:36:08 user nova-compute[72405]:       <target dev="tap607ff757-39"/>
Aug 08 23:36:08 user nova-compute[72405]:     </interface>
Aug 08 23:36:08 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:36:08 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/console.log" append="off"/>
Aug 08 23:36:08 user nova-compute[72405]:     </serial>
Aug 08 23:36:08 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:36:08 user nova-compute[72405]:     <video>
Aug 08 23:36:08 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:36:08 user nova-compute[72405]:     </video>
Aug 08 23:36:08 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:36:08 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:36:08 user nova-compute[72405]:     </rng>
Aug 08 23:36:08 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:36:08 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:36:08 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:36:08 user nova-compute[72405]:     </memballoon>
Aug 08 23:36:08 user nova-compute[72405]:   </devices>
Aug 08 23:36:08 user nova-compute[72405]: </domain>
Aug 08 23:36:08 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:36:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance destroyed successfully.
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:36:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] No VIF found with MAC fa:16:3e:11:0a:0b, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:36:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-f418e1c3-f199-414c-845b-adc166cb987d req-1217e4fd-5bc4-4d08-88eb-d89c8c13b3fa service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f418e1c3-f199-414c-845b-adc166cb987d req-1217e4fd-5bc4-4d08-88eb-d89c8c13b3fa service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f418e1c3-f199-414c-845b-adc166cb987d req-1217e4fd-5bc4-4d08-88eb-d89c8c13b3fa service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f418e1c3-f199-414c-845b-adc166cb987d req-1217e4fd-5bc4-4d08-88eb-d89c8c13b3fa service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-f418e1c3-f199-414c-845b-adc166cb987d req-1217e4fd-5bc4-4d08-88eb-d89c8c13b3fa service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:10 user nova-compute[72405]: WARNING nova.compute.manager [req-f418e1c3-f199-414c-845b-adc166cb987d req-1217e4fd-5bc4-4d08-88eb-d89c8c13b3fa service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state active and task_state rescuing.
Aug 08 23:36:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for b410b764-3eab-40f1-9e27-81cefe78b0e3 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537772.4109054, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Resumed (Lifecycle Event)
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-4754fce5-e569-4ffb-b553-a1e5e98f5e01 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:36:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537772.4111907, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Started (Lifecycle Event)
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd3ae637-0f32-46be-8f8d-64a123d4794d req-af31ab37-302d-449f-adf3-dc7a0566bfbc service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd3ae637-0f32-46be-8f8d-64a123d4794d req-af31ab37-302d-449f-adf3-dc7a0566bfbc service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd3ae637-0f32-46be-8f8d-64a123d4794d req-af31ab37-302d-449f-adf3-dc7a0566bfbc service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd3ae637-0f32-46be-8f8d-64a123d4794d req-af31ab37-302d-449f-adf3-dc7a0566bfbc service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd3ae637-0f32-46be-8f8d-64a123d4794d req-af31ab37-302d-449f-adf3-dc7a0566bfbc service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:12 user nova-compute[72405]: WARNING nova.compute.manager [req-bd3ae637-0f32-46be-8f8d-64a123d4794d req-af31ab37-302d-449f-adf3-dc7a0566bfbc service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state active and task_state rescuing.
Aug 08 23:36:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:16 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537761.9079986, 3ff81abc-acf0-4d6e-b88b-3db62c9f9080 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:16 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] VM Stopped (Lifecycle Event)
Aug 08 23:36:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d437c4c6-1e98-4042-9f3f-2133fda2c4ef None None] [instance: 3ff81abc-acf0-4d6e-b88b-3db62c9f9080] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:20 user nova-compute[72405]: INFO nova.compute.manager [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Detaching volume 634ac31f-8052-45b7-ae48-b5a3981084fa
Aug 08 23:36:20 user nova-compute[72405]: INFO nova.virt.block_device [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Attempting to driver detach volume 634ac31f-8052-45b7-ae48-b5a3981084fa from mountpoint /dev/vdb
Aug 08 23:36:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Attempting to detach device vdb from instance 022fd230-37ed-4a22-925c-64e9326c72fd from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:36:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:36:20 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:36:20 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:36:20 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:36:20 user nova-compute[72405]:   <serial>634ac31f-8052-45b7-ae48-b5a3981084fa</serial>
Aug 08 23:36:20 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:36:20 user nova-compute[72405]: </disk>
Aug 08 23:36:20 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:36:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully detached device vdb from instance 022fd230-37ed-4a22-925c-64e9326c72fd from the persistent domain config.
Aug 08 23:36:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 022fd230-37ed-4a22-925c-64e9326c72fd from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:36:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:36:20 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:36:20 user nova-compute[72405]:   <source dev="/dev/sdg"/>
Aug 08 23:36:20 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:36:20 user nova-compute[72405]:   <serial>634ac31f-8052-45b7-ae48-b5a3981084fa</serial>
Aug 08 23:36:20 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:36:20 user nova-compute[72405]: </disk>
Aug 08 23:36:20 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691537781.24547, 022fd230-37ed-4a22-925c-64e9326c72fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:36:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully detached device vdb from instance 022fd230-37ed-4a22-925c-64e9326c72fd from the live domain config.
Aug 08 23:36:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxgJcHME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:36:21 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e81601a-81e8-4b48-9074-b0be586340db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e52938-b33d-48d5-a009-7e7dd7237708]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:21 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:21 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:21 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:36:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:21 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:21 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:21 user nova-compute[72405]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa (non-flash)
Aug 08 23:36:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f58670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa'): ({'sdg'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Removing single pathed devices sdg {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e648b-316e-429d-a10c-2dd272d47761]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c08c8-3f4e-48b1-8bcf-98ec13cbe7c6]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Flushing IO for device /dev/sdg {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1aa671-fc94-4c37-b4c1-3fbdcabda047]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c241910-5c14-4743-8818-9ad9a96a22e7]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] SCSI volumes sdg have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45e0bd3-00e7-47d3-8caa-2c380d83249d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceaee42-40cd-485f-bc5d-dec4cc99378e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260]
Aug 08 23:36:21 user nova-compute[72405]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa, portal: 172.16.0.220,3260] successful.
Aug 08 23:36:21 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d12dd-9c29-4c68-8a8d-1ae9da9d5b73]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== disconnect_volume: return (373ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:36:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG nova.objects.instance [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'flavor' on Instance uuid 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-04de4de8-b159-46e7-a7da-9065bbf650b8 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.875s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.744s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:22 user nova-compute[72405]: INFO nova.compute.manager [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Terminating instance
Aug 08 23:36:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-c918be87-488c-446c-a521-e807fce4bab6 req-c236c6b8-c15c-4251-a21b-12b973adb9db service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-unplugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c918be87-488c-446c-a521-e807fce4bab6 req-c236c6b8-c15c-4251-a21b-12b973adb9db service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c918be87-488c-446c-a521-e807fce4bab6 req-c236c6b8-c15c-4251-a21b-12b973adb9db service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c918be87-488c-446c-a521-e807fce4bab6 req-c236c6b8-c15c-4251-a21b-12b973adb9db service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-c918be87-488c-446c-a521-e807fce4bab6 req-c236c6b8-c15c-4251-a21b-12b973adb9db service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-unplugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-c918be87-488c-446c-a521-e807fce4bab6 req-c236c6b8-c15c-4251-a21b-12b973adb9db service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-unplugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Instance destroyed successfully.
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lazy-loading 'resources' on Instance uuid 022fd230-37ed-4a22-925c-64e9326c72fd {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1677502484',display_name='tempest-VolumesSnapshotTestJSON-instance-1677502484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1677502484',id=30,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdI0I/Vzbywdv+J7jREg6wYnMiI4F+pR9ZmTkKtBAfQTi6szdfmiksAXCzfFa22FVJ7LP73grSgHalM8/JKv07AuEz/xU/ZChGY+rGLbqGh2iwN8mUTA8FcnthBErfyHQ==',key_name='tempest-keypair-1513594986',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75e9333fa38e4335ae6b2eabc3a579c0',ramdisk_id='',reservation_id='r-iaswx0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1813381307',owner_user_name='tempest-VolumesSnapshotTestJSON-1813381307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a44d888f97048c9b47154e7700bb9fa',uuid=022fd230-37ed-4a22-925c-64e9326c72fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converting VIF {"id": "ff8c538f-c133-4e83-b563-03067ff812f7", "address": "fa:16:3e:e1:a7:d5", "network": {"id": "db749b74-0626-4591-828e-b376d271280c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-842785590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75e9333fa38e4335ae6b2eabc3a579c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8c538f-c1", "ovs_interfaceid": "ff8c538f-c133-4e83-b563-03067ff812f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_vif [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff8c538f-c1, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: INFO os_vif [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:a7:d5,bridge_name='br-int',has_traffic_filtering=True,id=ff8c538f-c133-4e83-b563-03067ff812f7,network=Network(db749b74-0626-4591-828e-b376d271280c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8c538f-c1')
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxgJcHME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:36:23 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634ac31f-8052-45b7-ae48-b5a3981084fa', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd6515c-7cca-498f-af1a-6ac614cfa414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1774af43-9d98-498b-8046-f1a82b489cc3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:23 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:23 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:23 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:23 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:23 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9815dd80>, {}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Disconnecting from: [] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] <== disconnect_volume: return (54ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:36:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Deleting instance files /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd_del
Aug 08 23:36:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Deletion of /opt/stack/data/nova/instances/022fd230-37ed-4a22-925c-64e9326c72fd_del complete
Aug 08 23:36:23 user nova-compute[72405]: INFO nova.compute.manager [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 08 23:36:23 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:24 user nova-compute[72405]: WARNING nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state active and task_state deleting.
Aug 08 23:36:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:24 user nova-compute[72405]: WARNING nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state active and task_state deleting.
Aug 08 23:36:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:24 user nova-compute[72405]: WARNING nova.compute.manager [req-84461977-a17b-422c-8404-066463bf38f4 req-fec311a1-9391-4348-8918-8c4f187a0756 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state active and task_state deleting.
Aug 08 23:36:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:26 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Took 2.53 seconds to deallocate network for instance.
Aug 08 23:36:26 user nova-compute[72405]: WARNING nova.volume.cinder [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Attachment b763daff-2854-40de-839c-aae4c6b34cff does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b763daff-2854-40de-839c-aae4c6b34cff. (HTTP 404) (Request-ID: req-ad2246a6-301e-4fb0-83c7-d4a8f1523f0b)
Aug 08 23:36:26 user nova-compute[72405]: INFO nova.compute.manager [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Took 0.03 seconds to detach 1 volumes for instance.
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:26 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Deleted allocations for instance 022fd230-37ed-4a22-925c-64e9326c72fd
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9f695203-5bc9-4a1a-9d56-bcea15417992 tempest-VolumesSnapshotTestJSON-1813381307 tempest-VolumesSnapshotTestJSON-1813381307-project-member] Lock "022fd230-37ed-4a22-925c-64e9326c72fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.165s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-unplugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-unplugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:26 user nova-compute[72405]: WARNING nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-unplugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state deleted and task_state None.
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] Acquiring lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] Lock "022fd230-37ed-4a22-925c-64e9326c72fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] No waiting events found dispatching network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:26 user nova-compute[72405]: WARNING nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received unexpected event network-vif-plugged-ff8c538f-c133-4e83-b563-03067ff812f7 for instance with vm_state deleted and task_state None.
Aug 08 23:36:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-41defc09-6f8c-4c2f-83ee-b515c993dec2 req-3aab88e0-b5e4-4825-a6d1-d2ec80ecc008 service nova] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Received event network-vif-deleted-ff8c538f-c133-4e83-b563-03067ff812f7 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:36:31 user nova-compute[72405]: INFO nova.compute.claims [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Claim successful on node user
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:36:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.policy [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95d69553a04149d1a0a53ac53194db88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2429c9eebe014d6f9bc61ff7b6cc68d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:36:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Creating image(s)
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "/opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "/opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "/opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk 1073741824" returned: 0 in 0.056s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Successfully created port: d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Cannot resize image /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lazy-loading 'migration_context' on Instance uuid e86ae2e2-81b1-4ab8-add8-1b74187ae7db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Ensure instance console log exists: /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Successfully updated port: d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-changed-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Refreshing instance network info cache due to event network-changed-d11416bb-91ee-4090-9062-1be48bc498f6. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] Acquiring lock "refresh_cache-e86ae2e2-81b1-4ab8-add8-1b74187ae7db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] Acquired lock "refresh_cache-e86ae2e2-81b1-4ab8-add8-1b74187ae7db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Refreshing network info cache for port d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "refresh_cache-e86ae2e2-81b1-4ab8-add8-1b74187ae7db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-80870b1c-49fa-4f9e-859a-91cb2c309a39 req-3626b76d-6008-4cda-97e0-d1b97f494aa0 service nova] Releasing lock "refresh_cache-e86ae2e2-81b1-4ab8-add8-1b74187ae7db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquired lock "refresh_cache-e86ae2e2-81b1-4ab8-add8-1b74187ae7db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Updating instance_info_cache with network_info: [{"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Releasing lock "refresh_cache-e86ae2e2-81b1-4ab8-add8-1b74187ae7db" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Instance network_info: |[{"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Start _get_guest_xml network_info=[{"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:36:33 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:33 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1955314979',display_name='tempest-VolumesActionsTest-instance-1955314979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1955314979',id=32,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2429c9eebe014d6f9bc61ff7b6cc68d4',ramdisk_id='',reservation_id='r-syheldks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261489940',owner_user_name='tempest-VolumesActionsTest-261489940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:36:32Z,user_data=None,user_id='95d69553a04149d1a0a53ac53194db88',uuid=e86ae2e2-81b1-4ab8-add8-1b74187ae7db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converting VIF {"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lazy-loading 'pci_devices' on Instance uuid e86ae2e2-81b1-4ab8-add8-1b74187ae7db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:36:33 user nova-compute[72405]:   <uuid>e86ae2e2-81b1-4ab8-add8-1b74187ae7db</uuid>
Aug 08 23:36:33 user nova-compute[72405]:   <name>instance-00000020</name>
Aug 08 23:36:33 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:36:33 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:36:33 user nova-compute[72405]:   <metadata>
Aug 08 23:36:33 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:36:33 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:36:33 user nova-compute[72405]:       <nova:name>tempest-VolumesActionsTest-instance-1955314979</nova:name>
Aug 08 23:36:33 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:36:33</nova:creationTime>
Aug 08 23:36:33 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:36:33 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:36:33 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:36:33 user nova-compute[72405]:       <nova:owner>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:user uuid="95d69553a04149d1a0a53ac53194db88">tempest-VolumesActionsTest-261489940-project-member</nova:user>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:project uuid="2429c9eebe014d6f9bc61ff7b6cc68d4">tempest-VolumesActionsTest-261489940</nova:project>
Aug 08 23:36:33 user nova-compute[72405]:       </nova:owner>
Aug 08 23:36:33 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:36:33 user nova-compute[72405]:       <nova:ports>
Aug 08 23:36:33 user nova-compute[72405]:         <nova:port uuid="d11416bb-91ee-4090-9062-1be48bc498f6">
Aug 08 23:36:33 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:36:33 user nova-compute[72405]:         </nova:port>
Aug 08 23:36:33 user nova-compute[72405]:       </nova:ports>
Aug 08 23:36:33 user nova-compute[72405]:     </nova:instance>
Aug 08 23:36:33 user nova-compute[72405]:   </metadata>
Aug 08 23:36:33 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:36:33 user nova-compute[72405]:     <system>
Aug 08 23:36:33 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:36:33 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:36:33 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:36:33 user nova-compute[72405]:       <entry name="serial">e86ae2e2-81b1-4ab8-add8-1b74187ae7db</entry>
Aug 08 23:36:33 user nova-compute[72405]:       <entry name="uuid">e86ae2e2-81b1-4ab8-add8-1b74187ae7db</entry>
Aug 08 23:36:33 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:36:33 user nova-compute[72405]:     </system>
Aug 08 23:36:33 user nova-compute[72405]:   </sysinfo>
Aug 08 23:36:33 user nova-compute[72405]:   <os>
Aug 08 23:36:33 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:36:33 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:36:33 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:36:33 user nova-compute[72405]:   </os>
Aug 08 23:36:33 user nova-compute[72405]:   <features>
Aug 08 23:36:33 user nova-compute[72405]:     <acpi/>
Aug 08 23:36:33 user nova-compute[72405]:     <apic/>
Aug 08 23:36:33 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:36:33 user nova-compute[72405]:   </features>
Aug 08 23:36:33 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:36:33 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:36:33 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:36:33 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:36:33 user nova-compute[72405]:   </clock>
Aug 08 23:36:33 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:36:33 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:36:33 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:36:33 user nova-compute[72405]:   </cpu>
Aug 08 23:36:33 user nova-compute[72405]:   <devices>
Aug 08 23:36:33 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:36:33 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:36:33 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk"/>
Aug 08 23:36:33 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:36:33 user nova-compute[72405]:     </disk>
Aug 08 23:36:33 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:36:33 user nova-compute[72405]:       <mac address="fa:16:3e:1d:d9:03"/>
Aug 08 23:36:33 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:36:33 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:36:33 user nova-compute[72405]:       <target dev="tapd11416bb-91"/>
Aug 08 23:36:33 user nova-compute[72405]:     </interface>
Aug 08 23:36:33 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:36:33 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/console.log" append="off"/>
Aug 08 23:36:33 user nova-compute[72405]:     </serial>
Aug 08 23:36:33 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:36:33 user nova-compute[72405]:     <video>
Aug 08 23:36:33 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:36:33 user nova-compute[72405]:     </video>
Aug 08 23:36:33 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:36:33 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:36:33 user nova-compute[72405]:     </rng>
Aug 08 23:36:33 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:36:33 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:36:33 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:36:33 user nova-compute[72405]:     </memballoon>
Aug 08 23:36:33 user nova-compute[72405]:   </devices>
Aug 08 23:36:33 user nova-compute[72405]: </domain>
Aug 08 23:36:33 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1955314979',display_name='tempest-VolumesActionsTest-instance-1955314979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1955314979',id=32,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2429c9eebe014d6f9bc61ff7b6cc68d4',ramdisk_id='',reservation_id='r-syheldks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261489940',owner_user_name='tempest-VolumesActionsTest-261489940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:36:32Z,user_data=None,user_id='95d69553a04149d1a0a53ac53194db88',uuid=e86ae2e2-81b1-4ab8-add8-1b74187ae7db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converting VIF {"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG os_vif [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd11416bb-91, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd11416bb-91, col_values=(('external_ids', {'iface-id': 'd11416bb-91ee-4090-9062-1be48bc498f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:d9:03', 'vm-uuid': 'e86ae2e2-81b1-4ab8-add8-1b74187ae7db'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:33 user nova-compute[72405]: INFO os_vif [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91')
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:36:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] No VIF found with MAC fa:16:3e:1d:d9:03, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:36:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-c0444ce6-5ddb-433b-b8b4-ed01b92be905 req-13dac978-5ab4-4e6a-b448-d192e384baca service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c0444ce6-5ddb-433b-b8b4-ed01b92be905 req-13dac978-5ab4-4e6a-b448-d192e384baca service nova] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c0444ce6-5ddb-433b-b8b4-ed01b92be905 req-13dac978-5ab4-4e6a-b448-d192e384baca service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c0444ce6-5ddb-433b-b8b4-ed01b92be905 req-13dac978-5ab4-4e6a-b448-d192e384baca service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-c0444ce6-5ddb-433b-b8b4-ed01b92be905 req-13dac978-5ab4-4e6a-b448-d192e384baca service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] No waiting events found dispatching network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:35 user nova-compute[72405]: WARNING nova.compute.manager [req-c0444ce6-5ddb-433b-b8b4-ed01b92be905 req-13dac978-5ab4-4e6a-b448-d192e384baca service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received unexpected event network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 for instance with vm_state building and task_state spawning.
Aug 08 23:36:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537797.3233457, e86ae2e2-81b1-4ab8-add8-1b74187ae7db => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] VM Resumed (Lifecycle Event)
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Instance spawned successfully.
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-3c9ee312-72a2-4f6d-9064-ce8b78faa2f9 req-0bca9358-80a5-4305-91ea-21f6e420681c service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3c9ee312-72a2-4f6d-9064-ce8b78faa2f9 req-0bca9358-80a5-4305-91ea-21f6e420681c service nova] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3c9ee312-72a2-4f6d-9064-ce8b78faa2f9 req-0bca9358-80a5-4305-91ea-21f6e420681c service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3c9ee312-72a2-4f6d-9064-ce8b78faa2f9 req-0bca9358-80a5-4305-91ea-21f6e420681c service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [req-3c9ee312-72a2-4f6d-9064-ce8b78faa2f9 req-0bca9358-80a5-4305-91ea-21f6e420681c service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] No waiting events found dispatching network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:37 user nova-compute[72405]: WARNING nova.compute.manager [req-3c9ee312-72a2-4f6d-9064-ce8b78faa2f9 req-0bca9358-80a5-4305-91ea-21f6e420681c service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received unexpected event network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 for instance with vm_state building and task_state spawning.
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537797.3264754, e86ae2e2-81b1-4ab8-add8-1b74187ae7db => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] VM Started (Lifecycle Event)
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 08 23:36:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:36:37 user nova-compute[72405]: INFO nova.compute.manager [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Took 6.50 seconds to build instance.
Aug 08 23:36:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f24328c8-095d-4c8a-a5a9-4286ea8c8e8f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.599s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:38 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537783.2668736, 022fd230-37ed-4a22-925c-64e9326c72fd => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:38 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] VM Stopped (Lifecycle Event)
Aug 08 23:36:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9ad99156-8d49-4787-9f51-6426a43e918e None None] [instance: 022fd230-37ed-4a22-925c-64e9326c72fd] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:36:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [{"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-2adde477-61ea-4f06-a71d-86a3d94902f2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:41 user nova-compute[72405]: INFO nova.compute.manager [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Terminating instance
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-8dd56066-a0de-4cd8-a078-106c1e98acb9 req-525b1bf7-1cee-47cb-bb12-2e6b30ea91c8 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-vif-unplugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8dd56066-a0de-4cd8-a078-106c1e98acb9 req-525b1bf7-1cee-47cb-bb12-2e6b30ea91c8 service nova] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8dd56066-a0de-4cd8-a078-106c1e98acb9 req-525b1bf7-1cee-47cb-bb12-2e6b30ea91c8 service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8dd56066-a0de-4cd8-a078-106c1e98acb9 req-525b1bf7-1cee-47cb-bb12-2e6b30ea91c8 service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-8dd56066-a0de-4cd8-a078-106c1e98acb9 req-525b1bf7-1cee-47cb-bb12-2e6b30ea91c8 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] No waiting events found dispatching network-vif-unplugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-8dd56066-a0de-4cd8-a078-106c1e98acb9 req-525b1bf7-1cee-47cb-bb12-2e6b30ea91c8 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-vif-unplugged-66c4a5b9-cee6-4852-bb58-79c44f919792 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:36:42 user nova-compute[72405]: INFO nova.compute.claims [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Claim successful on node user
Aug 08 23:36:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Instance destroyed successfully.
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lazy-loading 'resources' on Instance uuid 8e0172ab-2223-492a-8dd5-985228661916 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-570121098',display_name='tempest-AttachVolumeNegativeTest-server-570121098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-570121098',id=29,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfQO4cFP1G0eJW8k9vdrR5FXt4N1kCg9uTRb9I0y/P1pEq7kbKfWCs0azGyRYghD5+DYbYqkb3LmPXmTNCytJ7hxrJ0sOeWYVzo5UGh54b2K3uSdlQ6STfc3Zv8+bQM0Q==',key_name='tempest-keypair-183601721',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:33:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a146c9a0c224249ac3316e931874bc5',ramdisk_id='',reservation_id='r-4o9gkvmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1663634564',owner_user_name='tempest-AttachVolumeNegativeTest-1663634564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8334edbf14ec382f6cd1c426703c6',uuid=8e0172ab-2223-492a-8dd5-985228661916,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converting VIF {"id": "66c4a5b9-cee6-4852-bb58-79c44f919792", "address": "fa:16:3e:8a:d7:4e", "network": {"id": "a2dfcf35-c613-4987-ba45-7332603896c6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1005443490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a146c9a0c224249ac3316e931874bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c4a5b9-ce", "ovs_interfaceid": "66c4a5b9-cee6-4852-bb58-79c44f919792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG os_vif [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66c4a5b9-ce, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:42 user nova-compute[72405]: INFO os_vif [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d7:4e,bridge_name='br-int',has_traffic_filtering=True,id=66c4a5b9-cee6-4852-bb58-79c44f919792,network=Network(a2dfcf35-c613-4987-ba45-7332603896c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c4a5b9-ce')
Aug 08 23:36:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Deleting instance files /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916_del
Aug 08 23:36:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Deletion of /opt/stack/data/nova/instances/8e0172ab-2223-492a-8dd5-985228661916_del complete
Aug 08 23:36:42 user nova-compute[72405]: INFO nova.compute.manager [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:36:43 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:36:43 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Creating image(s)
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "/opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "/opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "/opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.policy [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea9b9cda387451ea9e40630216969bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e74c497139142c6bb15ba99d7277b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk 1073741824" returned: 0 in 0.065s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-4b9cab6a-cf55-4125-b573-8ffb1cb82eb9 req-45d29e38-2a37-4276-8a05-7e8cb25177b0 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4b9cab6a-cf55-4125-b573-8ffb1cb82eb9 req-45d29e38-2a37-4276-8a05-7e8cb25177b0 service nova] Acquiring lock "8e0172ab-2223-492a-8dd5-985228661916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4b9cab6a-cf55-4125-b573-8ffb1cb82eb9 req-45d29e38-2a37-4276-8a05-7e8cb25177b0 service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4b9cab6a-cf55-4125-b573-8ffb1cb82eb9 req-45d29e38-2a37-4276-8a05-7e8cb25177b0 service nova] Lock "8e0172ab-2223-492a-8dd5-985228661916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-4b9cab6a-cf55-4125-b573-8ffb1cb82eb9 req-45d29e38-2a37-4276-8a05-7e8cb25177b0 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] No waiting events found dispatching network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:43 user nova-compute[72405]: WARNING nova.compute.manager [req-4b9cab6a-cf55-4125-b573-8ffb1cb82eb9 req-45d29e38-2a37-4276-8a05-7e8cb25177b0 service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received unexpected event network-vif-plugged-66c4a5b9-cee6-4852-bb58-79c44f919792 for instance with vm_state active and task_state deleting.
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Cannot resize image /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:36:43 user nova-compute[72405]: DEBUG nova.objects.instance [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lazy-loading 'migration_context' on Instance uuid 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Ensure instance console log exists: /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:44 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Took 1.64 seconds to deallocate network for instance.
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-7b91a8b7-72c3-4949-88a1-b2d260725c37 req-20cbb7e7-0295-4e00-ae7c-b2441667052a service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Received event network-vif-deleted-66c4a5b9-cee6-4852-bb58-79c44f919792 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:44 user nova-compute[72405]: INFO nova.compute.manager [req-7b91a8b7-72c3-4949-88a1-b2d260725c37 req-20cbb7e7-0295-4e00-ae7c-b2441667052a service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Neutron deleted interface 66c4a5b9-cee6-4852-bb58-79c44f919792; detaching it from the instance and deleting it from the info cache
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-7b91a8b7-72c3-4949-88a1-b2d260725c37 req-20cbb7e7-0295-4e00-ae7c-b2441667052a service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-7b91a8b7-72c3-4949-88a1-b2d260725c37 req-20cbb7e7-0295-4e00-ae7c-b2441667052a service nova] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Detach interface failed, port_id=66c4a5b9-cee6-4852-bb58-79c44f919792, reason: Instance 8e0172ab-2223-492a-8dd5-985228661916 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Successfully created port: bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:44 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Deleted allocations for instance 8e0172ab-2223-492a-8dd5-985228661916
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-73cb3112-108c-4e81-ae12-9034f3b04975 tempest-AttachVolumeNegativeTest-1663634564 tempest-AttachVolumeNegativeTest-1663634564-project-member] Lock "8e0172ab-2223-492a-8dd5-985228661916" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.480s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid '8e0172ab-2223-492a-8dd5-985228661916' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid '8e0172ab-2223-492a-8dd5-985228661916' (instance-0000001d)
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Successfully updated port: bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:36:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:45 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7728MB free_disk=25.157337188720703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquired lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance b410b764-3eab-40f1-9e27-81cefe78b0e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e86ae2e2-81b1-4ab8-add8-1b74187ae7db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:45 user nova-compute[72405]: INFO nova.compute.manager [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Terminating instance
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updating instance_info_cache with network_info: [{"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Releasing lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Instance network_info: |[{"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Start _get_guest_xml network_info=[{"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:36:45 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1646054832',display_name='tempest-ServersNegativeTestJSON-server-1646054832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1646054832',id=33,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e74c497139142c6bb15ba99d7277b8f',ramdisk_id='',reservation_id='r-8e32v67n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1093456984',owner_user_name='tempest-ServersNegativeTestJSON-1093456984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:36:43Z,user_data=None,user_id='fea9b9cda387451ea9e40630216969bb',uuid=44f91b94-b7b6-4c8f-95c4-0bf2d26ca228,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converting VIF {"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.objects.instance [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lazy-loading 'pci_devices' on Instance uuid 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:36:46 user nova-compute[72405]:   <uuid>44f91b94-b7b6-4c8f-95c4-0bf2d26ca228</uuid>
Aug 08 23:36:46 user nova-compute[72405]:   <name>instance-00000021</name>
Aug 08 23:36:46 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:36:46 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:36:46 user nova-compute[72405]:   <metadata>
Aug 08 23:36:46 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:36:46 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:36:46 user nova-compute[72405]:       <nova:name>tempest-ServersNegativeTestJSON-server-1646054832</nova:name>
Aug 08 23:36:46 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:36:46</nova:creationTime>
Aug 08 23:36:46 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:36:46 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:36:46 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:36:46 user nova-compute[72405]:       <nova:owner>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:user uuid="fea9b9cda387451ea9e40630216969bb">tempest-ServersNegativeTestJSON-1093456984-project-member</nova:user>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:project uuid="0e74c497139142c6bb15ba99d7277b8f">tempest-ServersNegativeTestJSON-1093456984</nova:project>
Aug 08 23:36:46 user nova-compute[72405]:       </nova:owner>
Aug 08 23:36:46 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:36:46 user nova-compute[72405]:       <nova:ports>
Aug 08 23:36:46 user nova-compute[72405]:         <nova:port uuid="bfca3a1c-2974-4061-8b49-a9f3695df17f">
Aug 08 23:36:46 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:36:46 user nova-compute[72405]:         </nova:port>
Aug 08 23:36:46 user nova-compute[72405]:       </nova:ports>
Aug 08 23:36:46 user nova-compute[72405]:     </nova:instance>
Aug 08 23:36:46 user nova-compute[72405]:   </metadata>
Aug 08 23:36:46 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:36:46 user nova-compute[72405]:     <system>
Aug 08 23:36:46 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:36:46 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:36:46 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:36:46 user nova-compute[72405]:       <entry name="serial">44f91b94-b7b6-4c8f-95c4-0bf2d26ca228</entry>
Aug 08 23:36:46 user nova-compute[72405]:       <entry name="uuid">44f91b94-b7b6-4c8f-95c4-0bf2d26ca228</entry>
Aug 08 23:36:46 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:36:46 user nova-compute[72405]:     </system>
Aug 08 23:36:46 user nova-compute[72405]:   </sysinfo>
Aug 08 23:36:46 user nova-compute[72405]:   <os>
Aug 08 23:36:46 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:36:46 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:36:46 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:36:46 user nova-compute[72405]:   </os>
Aug 08 23:36:46 user nova-compute[72405]:   <features>
Aug 08 23:36:46 user nova-compute[72405]:     <acpi/>
Aug 08 23:36:46 user nova-compute[72405]:     <apic/>
Aug 08 23:36:46 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:36:46 user nova-compute[72405]:   </features>
Aug 08 23:36:46 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:36:46 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:36:46 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:36:46 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:36:46 user nova-compute[72405]:   </clock>
Aug 08 23:36:46 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:36:46 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:36:46 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:36:46 user nova-compute[72405]:   </cpu>
Aug 08 23:36:46 user nova-compute[72405]:   <devices>
Aug 08 23:36:46 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:36:46 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:36:46 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk"/>
Aug 08 23:36:46 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:36:46 user nova-compute[72405]:     </disk>
Aug 08 23:36:46 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:36:46 user nova-compute[72405]:       <mac address="fa:16:3e:33:ee:c8"/>
Aug 08 23:36:46 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:36:46 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:36:46 user nova-compute[72405]:       <target dev="tapbfca3a1c-29"/>
Aug 08 23:36:46 user nova-compute[72405]:     </interface>
Aug 08 23:36:46 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:36:46 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/console.log" append="off"/>
Aug 08 23:36:46 user nova-compute[72405]:     </serial>
Aug 08 23:36:46 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:36:46 user nova-compute[72405]:     <video>
Aug 08 23:36:46 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:36:46 user nova-compute[72405]:     </video>
Aug 08 23:36:46 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:36:46 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:36:46 user nova-compute[72405]:     </rng>
Aug 08 23:36:46 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:36:46 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:36:46 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:36:46 user nova-compute[72405]:     </memballoon>
Aug 08 23:36:46 user nova-compute[72405]:   </devices>
Aug 08 23:36:46 user nova-compute[72405]: </domain>
Aug 08 23:36:46 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1646054832',display_name='tempest-ServersNegativeTestJSON-server-1646054832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1646054832',id=33,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e74c497139142c6bb15ba99d7277b8f',ramdisk_id='',reservation_id='r-8e32v67n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1093456984',owner_user_name='tempest-ServersNegativeTestJSON-1093456984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:36:43Z,user_data=None,user_id='fea9b9cda387451ea9e40630216969bb',uuid=44f91b94-b7b6-4c8f-95c4-0bf2d26ca228,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converting VIF {"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG os_vif [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfca3a1c-29, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfca3a1c-29, col_values=(('external_ids', {'iface-id': 'bfca3a1c-2974-4061-8b49-a9f3695df17f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:ee:c8', 'vm-uuid': '44f91b94-b7b6-4c8f-95c4-0bf2d26ca228'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:46 user nova-compute[72405]: INFO os_vif [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29')
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-changed-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Refreshing instance network info cache due to event network-changed-bfca3a1c-2974-4061-8b49-a9f3695df17f. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] Acquiring lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] Acquired lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Refreshing network info cache for port bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] No VIF found with MAC fa:16:3e:33:ee:c8, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updated VIF entry in instance network info cache for port bfca3a1c-2974-4061-8b49-a9f3695df17f. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updating instance_info_cache with network_info: [{"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f2df3c9d-6bae-4183-aff6-79a1b36c8bb9 req-6083f482-1862-4602-bb2e-885ccd7ee092 service nova] Releasing lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:36:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Instance destroyed successfully.
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lazy-loading 'resources' on Instance uuid 9f105082-c7cc-4b7d-b6d4-04a293e832cf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1050796295',display_name='tempest-ServerActionsTestOtherB-server-1050796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1050796295',id=17,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysDD31PYK2E5Su8TiOyod/9rBtIdLcQnyLmK4eLUPhZZeIZeraA1t5lrQS53Gw/fN+nR+rSDHLLvmPM9E1lSCRrWoCIItMhHIgPmAP/0itxGklVL3p6aD6y+3NTA9RTQ==',key_name='tempest-keypair-663252967',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af7781e7654e447fb13a10725e45a2fe',ramdisk_id='',reservation_id='r-6f89p78n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1153417891',owner_user_name='tempest-ServerActionsTestOtherB-1153417891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fced4d4747e4e3abb0772b956bedba7',uuid=9f105082-c7cc-4b7d-b6d4-04a293e832cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converting VIF {"id": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "address": "fa:16:3e:2f:cf:a3", "network": {"id": "21e3353e-4ca9-4dd3-a0b9-e689d8f72afe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1195838920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7781e7654e447fb13a10725e45a2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f2e3cc-1e", "ovs_interfaceid": "f9f2e3cc-1e64-475b-9e4a-f1a0db25b771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_vif [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f2e3cc-1e, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:47 user nova-compute[72405]: INFO os_vif [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:cf:a3,bridge_name='br-int',has_traffic_filtering=True,id=f9f2e3cc-1e64-475b-9e4a-f1a0db25b771,network=Network(21e3353e-4ca9-4dd3-a0b9-e689d8f72afe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f2e3cc-1e')
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQAdeXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:36:47 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[13049cc4-814b-4b0f-8742-74e6d85b83c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5bdfca-07b4-490b-a8ef-233795508394]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:47 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:47 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:36:47 user nova-compute[72405]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead (non-flash)
Aug 08 23:36:47 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:36:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f3e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c43d5c8-54c4-480f-a3e2-12c6741ef869]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8acc39b-025e-42a7-aa29-7bacd5c4b33e]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b708a2c-4b6b-47ef-bf02-fc5976cb2f81]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f7ca1-de3e-4bf5-9e93-503862ed2de7]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fc2ca4-39c6-427a-9f48-fe692dbca135]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f99a4b-080f-47dc-96cd-e131c95330f4]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260]
Aug 08 23:36:47 user nova-compute[72405]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead, portal: 172.16.0.220,3260] successful.
Aug 08 23:36:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c092ae02-9d27-42ef-b4c5-f0953aa54ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0b84a8-60d2-45cd-b4bd-e3b206a37bae]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] <== disconnect_volume: return (326ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:36:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Deleting instance files /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf_del
Aug 08 23:36:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Deletion of /opt/stack/data/nova/instances/9f105082-c7cc-4b7d-b6d4-04a293e832cf_del complete
Aug 08 23:36:47 user nova-compute[72405]: INFO nova.compute.manager [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Took 1.78 seconds to destroy the instance on the hypervisor.
Aug 08 23:36:47 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:36:47 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-unplugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] Acquiring lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] No waiting events found dispatching network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:48 user nova-compute[72405]: WARNING nova.compute.manager [req-7c6bc1aa-cd03-4ed2-8249-f81d8e5b53aa req-0f24bcad-b999-42c0-88c8-9c926f0535ab service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received unexpected event network-vif-plugged-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 for instance with vm_state active and task_state deleting.
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-dbf62a4e-feca-4d70-82b0-fda669060161 req-b26bd9df-4089-49c7-b6ad-e05324e940fa service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dbf62a4e-feca-4d70-82b0-fda669060161 req-b26bd9df-4089-49c7-b6ad-e05324e940fa service nova] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dbf62a4e-feca-4d70-82b0-fda669060161 req-b26bd9df-4089-49c7-b6ad-e05324e940fa service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dbf62a4e-feca-4d70-82b0-fda669060161 req-b26bd9df-4089-49c7-b6ad-e05324e940fa service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-dbf62a4e-feca-4d70-82b0-fda669060161 req-b26bd9df-4089-49c7-b6ad-e05324e940fa service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] No waiting events found dispatching network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:48 user nova-compute[72405]: WARNING nova.compute.manager [req-dbf62a4e-feca-4d70-82b0-fda669060161 req-b26bd9df-4089-49c7-b6ad-e05324e940fa service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received unexpected event network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f for instance with vm_state building and task_state spawning.
Aug 08 23:36:48 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:48 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Took 0.87 seconds to deallocate network for instance.
Aug 08 23:36:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:36:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:49 user nova-compute[72405]: INFO nova.compute.manager [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Took 0.97 seconds to detach 1 volumes for instance.
Aug 08 23:36:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:49 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:49 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Deleted allocations for instance 9f105082-c7cc-4b7d-b6d4-04a293e832cf
Aug 08 23:36:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-4baa39fd-ac6c-4ac3-a5fa-f03fe358951e tempest-ServerActionsTestOtherB-1153417891 tempest-ServerActionsTestOtherB-1153417891-project-member] Lock "9f105082-c7cc-4b7d-b6d4-04a293e832cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.271s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-6b8c35f2-5a62-402b-b789-c8f163aeba9c req-0a9f2590-71a2-42f4-bee3-29e72f42ff12 service nova] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Received event network-vif-deleted-f9f2e3cc-1e64-475b-9e4a-f1a0db25b771 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537810.3333535, 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] VM Resumed (Lifecycle Event)
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Instance spawned successfully.
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537810.3378148, 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] VM Started (Lifecycle Event)
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-591924a7-e20e-4d0f-8798-3acc4ed52e97 req-0effa0a1-6716-4834-a98f-4446c8806413 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-591924a7-e20e-4d0f-8798-3acc4ed52e97 req-0effa0a1-6716-4834-a98f-4446c8806413 service nova] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-591924a7-e20e-4d0f-8798-3acc4ed52e97 req-0effa0a1-6716-4834-a98f-4446c8806413 service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-591924a7-e20e-4d0f-8798-3acc4ed52e97 req-0effa0a1-6716-4834-a98f-4446c8806413 service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-591924a7-e20e-4d0f-8798-3acc4ed52e97 req-0effa0a1-6716-4834-a98f-4446c8806413 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] No waiting events found dispatching network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:50 user nova-compute[72405]: WARNING nova.compute.manager [req-591924a7-e20e-4d0f-8798-3acc4ed52e97 req-0effa0a1-6716-4834-a98f-4446c8806413 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received unexpected event network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f for instance with vm_state building and task_state spawning.
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Took 7.25 seconds to spawn the instance on the hypervisor.
Aug 08 23:36:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:50 user nova-compute[72405]: INFO nova.compute.manager [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Took 8.39 seconds to build instance.
Aug 08 23:36:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-476a77b0-a3a0-4ded-9120-4312c5b7ffbe tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.490s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:54 user nova-compute[72405]: INFO nova.compute.manager [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Terminating instance
Aug 08 23:36:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-753ff1e9-c667-47de-9409-a6002375ed5c req-064cab49-1bc5-427c-be66-f86fb3b564e0 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-vif-unplugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-753ff1e9-c667-47de-9409-a6002375ed5c req-064cab49-1bc5-427c-be66-f86fb3b564e0 service nova] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-753ff1e9-c667-47de-9409-a6002375ed5c req-064cab49-1bc5-427c-be66-f86fb3b564e0 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-753ff1e9-c667-47de-9409-a6002375ed5c req-064cab49-1bc5-427c-be66-f86fb3b564e0 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-753ff1e9-c667-47de-9409-a6002375ed5c req-064cab49-1bc5-427c-be66-f86fb3b564e0 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] No waiting events found dispatching network-vif-unplugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-753ff1e9-c667-47de-9409-a6002375ed5c req-064cab49-1bc5-427c-be66-f86fb3b564e0 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-vif-unplugged-55e18cda-9a1e-47ed-b626-df5ad144df78 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Instance destroyed successfully.
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lazy-loading 'resources' on Instance uuid ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-88786235',display_name='tempest-TestServerVolumeAttachmentScenario-server-88786235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-88786235',id=27,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC984br+kwAxLBLJxH4ADW4uOcVNqydO6uEoFrOXjeF81yn02ir9SE1If5dDMvMqhTu986QQBryr9KpM80+gDyJjlSsDHGmvGyH9XJQFUI7SYlCSGcTESQQUM7czZtkf8Q==',key_name='tempest-keypair-33664245',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:33:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='247ab614640c4941ac18150695f535c3',ramdisk_id='',reservation_id='r-x75w9u0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2103023061',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2103023061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518b2ba023554beb98d6fe6ac9f9fa87',uuid=ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Converting VIF {"id": "55e18cda-9a1e-47ed-b626-df5ad144df78", "address": "fa:16:3e:e5:c7:7e", "network": {"id": "71da0a84-93ec-4838-b82d-bfe413a878e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-90033020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247ab614640c4941ac18150695f535c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e18cda-9a", "ovs_interfaceid": "55e18cda-9a1e-47ed-b626-df5ad144df78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG os_vif [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55e18cda-9a, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:36:55 user nova-compute[72405]: INFO os_vif [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:7e,bridge_name='br-int',has_traffic_filtering=True,id=55e18cda-9a1e-47ed-b626-df5ad144df78,network=Network(71da0a84-93ec-4838-b82d-bfe413a878e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e18cda-9a')
Aug 08 23:36:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Deleting instance files /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf_del
Aug 08 23:36:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Deletion of /opt/stack/data/nova/instances/ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf_del complete
Aug 08 23:36:55 user nova-compute[72405]: INFO nova.compute.manager [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 08 23:36:55 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:36:55 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:36:57 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Took 1.32 seconds to deallocate network for instance.
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-19d9df45-a07e-4125-8d46-f661842e9be7 req-27296802-9c02-4bc4-969f-00ec08454870 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-vif-deleted-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-00426dd6-f7b4-4e5a-a5ee-058efd18a4c3 req-3f443a82-f382-4584-aa48-9fa1fee645f3 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received event network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-00426dd6-f7b4-4e5a-a5ee-058efd18a4c3 req-3f443a82-f382-4584-aa48-9fa1fee645f3 service nova] Acquiring lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-00426dd6-f7b4-4e5a-a5ee-058efd18a4c3 req-3f443a82-f382-4584-aa48-9fa1fee645f3 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-00426dd6-f7b4-4e5a-a5ee-058efd18a4c3 req-3f443a82-f382-4584-aa48-9fa1fee645f3 service nova] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-00426dd6-f7b4-4e5a-a5ee-058efd18a4c3 req-3f443a82-f382-4584-aa48-9fa1fee645f3 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] No waiting events found dispatching network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:36:57 user nova-compute[72405]: WARNING nova.compute.manager [req-00426dd6-f7b4-4e5a-a5ee-058efd18a4c3 req-3f443a82-f382-4584-aa48-9fa1fee645f3 service nova] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Received unexpected event network-vif-plugged-55e18cda-9a1e-47ed-b626-df5ad144df78 for instance with vm_state deleted and task_state None.
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537802.2965567, 8e0172ab-2223-492a-8dd5-985228661916 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:36:57 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 8e0172ab-2223-492a-8dd5-985228661916] VM Stopped (Lifecycle Event)
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-f3850ce6-7683-4653-926a-621daa043521 None None] [instance: 8e0172ab-2223-492a-8dd5-985228661916] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:57 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Deleted allocations for instance ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf
Aug 08 23:36:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-7d448470-7329-417a-8fd9-7296a3615811 tempest-TestServerVolumeAttachmentScenario-2103023061 tempest-TestServerVolumeAttachmentScenario-2103023061-project-member] Lock "ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:36:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:02 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537807.2574384, 9f105082-c7cc-4b7d-b6d4-04a293e832cf => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:37:02 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] VM Stopped (Lifecycle Event)
Aug 08 23:37:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b50e932e-2159-4fb6-85ce-e88e2f70771f None None] [instance: 9f105082-c7cc-4b7d-b6d4-04a293e832cf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:37:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:10 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537815.583137, ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:37:10 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] VM Stopped (Lifecycle Event)
Aug 08 23:37:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-72ddcf83-89ad-474d-b9a0-068269a33a59 None None] [instance: ab9dd1b3-6858-4c17-bf3d-7997d1dbaabf] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:37:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:37:30 user nova-compute[72405]: INFO nova.compute.claims [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Claim successful on node user
Aug 08 23:37:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:37:30 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:37:31 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:37:31 user nova-compute[72405]: DEBUG nova.policy [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2e4ec54172a455187e10b1b119c8cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628adffbe7ca403b8dc9c26f8254cddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:37:31 user nova-compute[72405]: INFO nova.virt.block_device [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Booting with volume e3a0cb73-0e44-4b84-a140-fabe8da72e62 at /dev/vda
Aug 08 23:37:31 user nova-compute[72405]: DEBUG os_brick.utils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[97da5e5c-7dc5-49f8-843b-c6146e1ef6c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe59229d-104c-4fa7-9f00-089639625942]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c5f477-ec88-4da6-b6d5-4923d8bdd180]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca17160-937f-4a51-bc3f-194013ecd092]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:37:31 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:37:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd969b0-7c69-43d5-846b-c22bcad3dc9f]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG os_brick.utils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating existing volume attachment record: 640672e0-1947-4f1a-b041-2015e5ef7674 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:37:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Successfully created port: 27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Successfully updated port: 27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-changed-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Refreshing instance network info cache due to event network-changed-27b2fc0e-b8bc-451c-89ed-5be2550f0e80. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:37:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:37:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:37:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:37:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance network_info: |[{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:37:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:37:33 user nova-compute[72405]: DEBUG nova.network.neutron [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Refreshing network info cache for port 27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:37:34 user nova-compute[72405]: DEBUG nova.network.neutron [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updated VIF entry in instance network info cache for port 27b2fc0e-b8bc-451c-89ed-5be2550f0e80. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:37:34 user nova-compute[72405]: DEBUG nova.network.neutron [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:37:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa595172-10db-485c-a38b-7248245481ce req-4c57a4ec-a1f2-4b90-afae-541c6cb8a09e service nova] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:37:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:36 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:37:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:37:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:37:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:37:38 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:37:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:37:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:37:38 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:37:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:41 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:37:44 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7745MB free_disk=25.171279907226562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance b410b764-3eab-40f1-9e27-81cefe78b0e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e86ae2e2-81b1-4ab8-add8-1b74187ae7db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:37:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:37:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Creating image(s)
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Ensure instance console log exists: /opt/stack/data/nova/instances/855c4ef2-9d79-4495-8dd4-21b8ae09e04f/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Start _get_guest_xml network_info=[{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '640672e0-1947-4f1a-b041-2015e5ef7674', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '855c4ef2-9d79-4495-8dd4-21b8ae09e04f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3a0cb73-0e44-4b84-a140-fabe8da72e62', 'serial': 'e3a0cb73-0e44-4b84-a140-fabe8da72e62'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:37:48 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:37:48 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:37:48 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:37:48 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:37:48 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e155de-59bf-4ea3-a080-08671f836062]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:37:48 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5431dc-de40-467f-865f-03ccdc244607]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62] added
Aug 08 23:37:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c45684-9b52-4667-9067-7d981aac0369]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b405d-6218-4819-9e84-896f721b4bed]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBoSZEHU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBoSZEHU" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f79803-9dff-4d22-b4b4-6703c7c1ea00]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBoSZEHU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61cc6b-4706-4512-903a-7230e68412d9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f577a-1dd1-486a-ba04-bf139074d3db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ce3ff-8a5b-4082-8108-8059ab39eca4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]
Aug 08 23:37:48 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.
Aug 08 23:37:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fd04c7-4bb7-4a3d-b680-c1a1727dc774]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4410639-a7ee-4e19-8de5-fd3aaa0e0585]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:37:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f595a65e-ec22-471c-92e9-dabd700602fc]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:37:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23130353134386239', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353134386239', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-20453789',display_name='tempest-ServerActionsTestOtherA-server-20453789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-20453789',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-1ub2fet6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=855c4ef2-9d79-4495-8dd4-21b8ae09e04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.objects.instance [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'pci_devices' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:37:49 user nova-compute[72405]:   <uuid>855c4ef2-9d79-4495-8dd4-21b8ae09e04f</uuid>
Aug 08 23:37:49 user nova-compute[72405]:   <name>instance-00000022</name>
Aug 08 23:37:49 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:37:49 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:37:49 user nova-compute[72405]:   <metadata>
Aug 08 23:37:49 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:37:49 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:37:49 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherA-server-20453789</nova:name>
Aug 08 23:37:49 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:37:48</nova:creationTime>
Aug 08 23:37:49 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:37:49 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:37:49 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:37:49 user nova-compute[72405]:       <nova:owner>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:user uuid="f2e4ec54172a455187e10b1b119c8cec">tempest-ServerActionsTestOtherA-1743133349-project-member</nova:user>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:project uuid="628adffbe7ca403b8dc9c26f8254cddb">tempest-ServerActionsTestOtherA-1743133349</nova:project>
Aug 08 23:37:49 user nova-compute[72405]:       </nova:owner>
Aug 08 23:37:49 user nova-compute[72405]:       <nova:ports>
Aug 08 23:37:49 user nova-compute[72405]:         <nova:port uuid="27b2fc0e-b8bc-451c-89ed-5be2550f0e80">
Aug 08 23:37:49 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:37:49 user nova-compute[72405]:         </nova:port>
Aug 08 23:37:49 user nova-compute[72405]:       </nova:ports>
Aug 08 23:37:49 user nova-compute[72405]:     </nova:instance>
Aug 08 23:37:49 user nova-compute[72405]:   </metadata>
Aug 08 23:37:49 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:37:49 user nova-compute[72405]:     <system>
Aug 08 23:37:49 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:37:49 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:37:49 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:37:49 user nova-compute[72405]:       <entry name="serial">855c4ef2-9d79-4495-8dd4-21b8ae09e04f</entry>
Aug 08 23:37:49 user nova-compute[72405]:       <entry name="uuid">855c4ef2-9d79-4495-8dd4-21b8ae09e04f</entry>
Aug 08 23:37:49 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:37:49 user nova-compute[72405]:     </system>
Aug 08 23:37:49 user nova-compute[72405]:   </sysinfo>
Aug 08 23:37:49 user nova-compute[72405]:   <os>
Aug 08 23:37:49 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:37:49 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:37:49 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:37:49 user nova-compute[72405]:   </os>
Aug 08 23:37:49 user nova-compute[72405]:   <features>
Aug 08 23:37:49 user nova-compute[72405]:     <acpi/>
Aug 08 23:37:49 user nova-compute[72405]:     <apic/>
Aug 08 23:37:49 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:37:49 user nova-compute[72405]:   </features>
Aug 08 23:37:49 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:37:49 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:37:49 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:37:49 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:37:49 user nova-compute[72405]:   </clock>
Aug 08 23:37:49 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:37:49 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:37:49 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:37:49 user nova-compute[72405]:   </cpu>
Aug 08 23:37:49 user nova-compute[72405]:   <devices>
Aug 08 23:37:49 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:37:49 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:37:49 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:37:49 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:37:49 user nova-compute[72405]:       <serial>e3a0cb73-0e44-4b84-a140-fabe8da72e62</serial>
Aug 08 23:37:49 user nova-compute[72405]:     </disk>
Aug 08 23:37:49 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:37:49 user nova-compute[72405]:       <mac address="fa:16:3e:e7:e9:e5"/>
Aug 08 23:37:49 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:37:49 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:37:49 user nova-compute[72405]:       <target dev="tap27b2fc0e-b8"/>
Aug 08 23:37:49 user nova-compute[72405]:     </interface>
Aug 08 23:37:49 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:37:49 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/855c4ef2-9d79-4495-8dd4-21b8ae09e04f/console.log" append="off"/>
Aug 08 23:37:49 user nova-compute[72405]:     </serial>
Aug 08 23:37:49 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:37:49 user nova-compute[72405]:     <video>
Aug 08 23:37:49 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:37:49 user nova-compute[72405]:     </video>
Aug 08 23:37:49 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:37:49 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:37:49 user nova-compute[72405]:     </rng>
Aug 08 23:37:49 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:37:49 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:37:49 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:37:49 user nova-compute[72405]:     </memballoon>
Aug 08 23:37:49 user nova-compute[72405]:   </devices>
Aug 08 23:37:49 user nova-compute[72405]: </domain>
Aug 08 23:37:49 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-20453789',display_name='tempest-ServerActionsTestOtherA-server-20453789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-20453789',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-1ub2fet6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=855c4ef2-9d79-4495-8dd4-21b8ae09e04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG os_vif [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b2fc0e-b8, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27b2fc0e-b8, col_values=(('external_ids', {'iface-id': '27b2fc0e-b8bc-451c-89ed-5be2550f0e80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:e9:e5', 'vm-uuid': '855c4ef2-9d79-4495-8dd4-21b8ae09e04f'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:49 user nova-compute[72405]: INFO os_vif [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8')
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:37:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No VIF found with MAC fa:16:3e:e7:e9:e5, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-519893ab-75ec-49b3-a44f-e44074ec20da req-eb3d1a6a-ea6a-4504-b305-9d48ae19b11f service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-519893ab-75ec-49b3-a44f-e44074ec20da req-eb3d1a6a-ea6a-4504-b305-9d48ae19b11f service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-519893ab-75ec-49b3-a44f-e44074ec20da req-eb3d1a6a-ea6a-4504-b305-9d48ae19b11f service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-519893ab-75ec-49b3-a44f-e44074ec20da req-eb3d1a6a-ea6a-4504-b305-9d48ae19b11f service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-519893ab-75ec-49b3-a44f-e44074ec20da req-eb3d1a6a-ea6a-4504-b305-9d48ae19b11f service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:37:51 user nova-compute[72405]: WARNING nova.compute.manager [req-519893ab-75ec-49b3-a44f-e44074ec20da req-eb3d1a6a-ea6a-4504-b305-9d48ae19b11f service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state building and task_state spawning.
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537873.8716292, 855c4ef2-9d79-4495-8dd4-21b8ae09e04f => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:37:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] VM Resumed (Lifecycle Event)
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:37:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance spawned successfully.
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:37:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537873.8727102, 855c4ef2-9d79-4495-8dd4-21b8ae09e04f => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:37:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] VM Started (Lifecycle Event)
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:37:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:37:53 user nova-compute[72405]: INFO nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 08 23:37:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6d52d78-7a03-4e2c-b7d4-927350294e6e req-f96849e6-64bc-43ac-b67f-640247068173 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6d52d78-7a03-4e2c-b7d4-927350294e6e req-f96849e6-64bc-43ac-b67f-640247068173 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6d52d78-7a03-4e2c-b7d4-927350294e6e req-f96849e6-64bc-43ac-b67f-640247068173 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6d52d78-7a03-4e2c-b7d4-927350294e6e req-f96849e6-64bc-43ac-b67f-640247068173 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6d52d78-7a03-4e2c-b7d4-927350294e6e req-f96849e6-64bc-43ac-b67f-640247068173 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:37:54 user nova-compute[72405]: WARNING nova.compute.manager [req-a6d52d78-7a03-4e2c-b7d4-927350294e6e req-f96849e6-64bc-43ac-b67f-640247068173 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state building and task_state spawning.
Aug 08 23:37:54 user nova-compute[72405]: INFO nova.compute.manager [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Took 23.45 seconds to build instance.
Aug 08 23:37:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-65b930cb-2929-4cce-b753-8e3a567af299 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.565s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:55 user nova-compute[72405]: INFO nova.compute.manager [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Unrescuing
Aug 08 23:37:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:37:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquired lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:37:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating instance_info_cache with network_info: [{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Releasing lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'flavor' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-c36b3c89-445a-46a3-9494-69526ad682cb req-41c683c0-8424-44e2-8d77-ae87963a2a60 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:37:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c36b3c89-445a-46a3-9494-69526ad682cb req-41c683c0-8424-44e2-8d77-ae87963a2a60 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c36b3c89-445a-46a3-9494-69526ad682cb req-41c683c0-8424-44e2-8d77-ae87963a2a60 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c36b3c89-445a-46a3-9494-69526ad682cb req-41c683c0-8424-44e2-8d77-ae87963a2a60 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-c36b3c89-445a-46a3-9494-69526ad682cb req-41c683c0-8424-44e2-8d77-ae87963a2a60 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:37:57 user nova-compute[72405]: WARNING nova.compute.manager [req-c36b3c89-445a-46a3-9494-69526ad682cb req-41c683c0-8424-44e2-8d77-ae87963a2a60 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:37:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance destroyed successfully.
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-869966fb-ec59-4e01-b6e6-cacef0aa56f6 req-e74a80c7-507e-4100-ae97-9b45f327fbf2 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-869966fb-ec59-4e01-b6e6-cacef0aa56f6 req-e74a80c7-507e-4100-ae97-9b45f327fbf2 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-869966fb-ec59-4e01-b6e6-cacef0aa56f6 req-e74a80c7-507e-4100-ae97-9b45f327fbf2 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-869966fb-ec59-4e01-b6e6-cacef0aa56f6 req-e74a80c7-507e-4100-ae97-9b45f327fbf2 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-869966fb-ec59-4e01-b6e6-cacef0aa56f6 req-e74a80c7-507e-4100-ae97-9b45f327fbf2 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:37:59 user nova-compute[72405]: WARNING nova.compute.manager [req-869966fb-ec59-4e01-b6e6-cacef0aa56f6 req-e74a80c7-507e-4100-ae97-9b45f327fbf2 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:37:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:01 user nova-compute[72405]: WARNING nova.compute.manager [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:01 user nova-compute[72405]: WARNING nova.compute.manager [req-92b18c9e-5a69-4451-b501-8c0e27699923 req-55f934ac-1ee8-4782-88f0-0b5e51a5f017 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for b410b764-3eab-40f1-9e27-81cefe78b0e3 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537881.5108306, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Resumed (Lifecycle Event)
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-223f5d86-cd4c-46aa-b76c-b90a79474b84 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537881.5174751, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Started (Lifecycle Event)
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:38:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:02 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:38:02 user nova-compute[72405]: INFO nova.compute.claims [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Claim successful on node user
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:38:03 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.policy [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94a805b078b640c29ae13aabfd1fd5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93111863a9dc43b9a50c61a6c1f4c52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:38:03 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Creating image(s)
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.206s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.192s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk 1073741824" returned: 0 in 0.093s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:38:04 user nova-compute[72405]: INFO nova.compute.claims [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Claim successful on node user
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.176s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Successfully created port: b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Cannot resize image /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.objects.instance [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'migration_context' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Ensure instance console log exists: /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:38:04 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:38:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:38:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Creating image(s)
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG nova.policy [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94a805b078b640c29ae13aabfd1fd5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93111863a9dc43b9a50c61a6c1f4c52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.171s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.200s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk 1073741824" returned: 0 in 0.082s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.177s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Successfully updated port: b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-changed-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Refreshing instance network info cache due to event network-changed-b831cee5-5e09-444f-98d9-f561e21aa92e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Cannot resize image /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'migration_context' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Ensure instance console log exists: /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:38:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Successfully created port: 5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance network_info: |[{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Refreshing network info cache for port b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Start _get_guest_xml network_info=[{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:38:07 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:07 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-140745293',display_name='tempest-ServerRescueNegativeTestJSON-server-140745293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-140745293',id=35,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5lyapbwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:04Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=04f2ae79-2d01-4a28-888c-93b50bc61a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'pci_devices' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:38:07 user nova-compute[72405]:   <uuid>04f2ae79-2d01-4a28-888c-93b50bc61a07</uuid>
Aug 08 23:38:07 user nova-compute[72405]:   <name>instance-00000023</name>
Aug 08 23:38:07 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:38:07 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:38:07 user nova-compute[72405]:   <metadata>
Aug 08 23:38:07 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:38:07 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:38:07 user nova-compute[72405]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-140745293</nova:name>
Aug 08 23:38:07 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:38:07</nova:creationTime>
Aug 08 23:38:07 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:38:07 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:38:07 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:38:07 user nova-compute[72405]:       <nova:owner>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:user uuid="94a805b078b640c29ae13aabfd1fd5a5">tempest-ServerRescueNegativeTestJSON-297666519-project-member</nova:user>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:project uuid="93111863a9dc43b9a50c61a6c1f4c52c">tempest-ServerRescueNegativeTestJSON-297666519</nova:project>
Aug 08 23:38:07 user nova-compute[72405]:       </nova:owner>
Aug 08 23:38:07 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:38:07 user nova-compute[72405]:       <nova:ports>
Aug 08 23:38:07 user nova-compute[72405]:         <nova:port uuid="b831cee5-5e09-444f-98d9-f561e21aa92e">
Aug 08 23:38:07 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 08 23:38:07 user nova-compute[72405]:         </nova:port>
Aug 08 23:38:07 user nova-compute[72405]:       </nova:ports>
Aug 08 23:38:07 user nova-compute[72405]:     </nova:instance>
Aug 08 23:38:07 user nova-compute[72405]:   </metadata>
Aug 08 23:38:07 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:38:07 user nova-compute[72405]:     <system>
Aug 08 23:38:07 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:38:07 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:38:07 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:38:07 user nova-compute[72405]:       <entry name="serial">04f2ae79-2d01-4a28-888c-93b50bc61a07</entry>
Aug 08 23:38:07 user nova-compute[72405]:       <entry name="uuid">04f2ae79-2d01-4a28-888c-93b50bc61a07</entry>
Aug 08 23:38:07 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:38:07 user nova-compute[72405]:     </system>
Aug 08 23:38:07 user nova-compute[72405]:   </sysinfo>
Aug 08 23:38:07 user nova-compute[72405]:   <os>
Aug 08 23:38:07 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:38:07 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:38:07 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:38:07 user nova-compute[72405]:   </os>
Aug 08 23:38:07 user nova-compute[72405]:   <features>
Aug 08 23:38:07 user nova-compute[72405]:     <acpi/>
Aug 08 23:38:07 user nova-compute[72405]:     <apic/>
Aug 08 23:38:07 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:38:07 user nova-compute[72405]:   </features>
Aug 08 23:38:07 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:38:07 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:38:07 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:38:07 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:38:07 user nova-compute[72405]:   </clock>
Aug 08 23:38:07 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:38:07 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:38:07 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:38:07 user nova-compute[72405]:   </cpu>
Aug 08 23:38:07 user nova-compute[72405]:   <devices>
Aug 08 23:38:07 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:38:07 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:38:07 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk"/>
Aug 08 23:38:07 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:38:07 user nova-compute[72405]:     </disk>
Aug 08 23:38:07 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:38:07 user nova-compute[72405]:       <mac address="fa:16:3e:63:5b:43"/>
Aug 08 23:38:07 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:38:07 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:38:07 user nova-compute[72405]:       <target dev="tapb831cee5-5e"/>
Aug 08 23:38:07 user nova-compute[72405]:     </interface>
Aug 08 23:38:07 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:38:07 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/console.log" append="off"/>
Aug 08 23:38:07 user nova-compute[72405]:     </serial>
Aug 08 23:38:07 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:38:07 user nova-compute[72405]:     <video>
Aug 08 23:38:07 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:38:07 user nova-compute[72405]:     </video>
Aug 08 23:38:07 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:38:07 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:38:07 user nova-compute[72405]:     </rng>
Aug 08 23:38:07 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:38:07 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:38:07 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:38:07 user nova-compute[72405]:     </memballoon>
Aug 08 23:38:07 user nova-compute[72405]:   </devices>
Aug 08 23:38:07 user nova-compute[72405]: </domain>
Aug 08 23:38:07 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-140745293',display_name='tempest-ServerRescueNegativeTestJSON-server-140745293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-140745293',id=35,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5lyapbwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:04Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=04f2ae79-2d01-4a28-888c-93b50bc61a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG os_vif [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb831cee5-5e, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb831cee5-5e, col_values=(('external_ids', {'iface-id': 'b831cee5-5e09-444f-98d9-f561e21aa92e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:5b:43', 'vm-uuid': '04f2ae79-2d01-4a28-888c-93b50bc61a07'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:07 user nova-compute[72405]: INFO os_vif [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e')
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:38:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:63:5b:43, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updated VIF entry in instance network info cache for port b831cee5-5e09-444f-98d9-f561e21aa92e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.network.neutron [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4229984c-a627-41bd-943c-3647d352104e req-da3609da-5b24-4e41-bf81-1e4cb501c05f service nova] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Successfully updated port: 5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-changed-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Refreshing instance network info cache due to event network-changed-5ccdec02-1dec-49f2-a61e-1f5f723aab05. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] Acquiring lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance network_info: |[{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] Acquired lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Refreshing network info cache for port 5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Start _get_guest_xml network_info=[{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:38:09 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:09 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-857807850',display_name='tempest-ServerRescueNegativeTestJSON-server-857807850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-857807850',id=36,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5brvflzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:05Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=74c3a8fc-fff0-422f-8583-142d7911e603,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'pci_devices' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-575dd245-bb6f-4b91-829c-7ef6bbb5c443 req-6c1d0383-f82b-477a-955b-5cd8bfcadb72 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-575dd245-bb6f-4b91-829c-7ef6bbb5c443 req-6c1d0383-f82b-477a-955b-5cd8bfcadb72 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-575dd245-bb6f-4b91-829c-7ef6bbb5c443 req-6c1d0383-f82b-477a-955b-5cd8bfcadb72 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-575dd245-bb6f-4b91-829c-7ef6bbb5c443 req-6c1d0383-f82b-477a-955b-5cd8bfcadb72 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-575dd245-bb6f-4b91-829c-7ef6bbb5c443 req-6c1d0383-f82b-477a-955b-5cd8bfcadb72 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:09 user nova-compute[72405]: WARNING nova.compute.manager [req-575dd245-bb6f-4b91-829c-7ef6bbb5c443 req-6c1d0383-f82b-477a-955b-5cd8bfcadb72 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state building and task_state spawning.
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:38:09 user nova-compute[72405]:   <uuid>74c3a8fc-fff0-422f-8583-142d7911e603</uuid>
Aug 08 23:38:09 user nova-compute[72405]:   <name>instance-00000024</name>
Aug 08 23:38:09 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:38:09 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:38:09 user nova-compute[72405]:   <metadata>
Aug 08 23:38:09 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:38:09 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:38:09 user nova-compute[72405]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-857807850</nova:name>
Aug 08 23:38:09 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:38:09</nova:creationTime>
Aug 08 23:38:09 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:38:09 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:38:09 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:38:09 user nova-compute[72405]:       <nova:owner>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:user uuid="94a805b078b640c29ae13aabfd1fd5a5">tempest-ServerRescueNegativeTestJSON-297666519-project-member</nova:user>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:project uuid="93111863a9dc43b9a50c61a6c1f4c52c">tempest-ServerRescueNegativeTestJSON-297666519</nova:project>
Aug 08 23:38:09 user nova-compute[72405]:       </nova:owner>
Aug 08 23:38:09 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:38:09 user nova-compute[72405]:       <nova:ports>
Aug 08 23:38:09 user nova-compute[72405]:         <nova:port uuid="5ccdec02-1dec-49f2-a61e-1f5f723aab05">
Aug 08 23:38:09 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:38:09 user nova-compute[72405]:         </nova:port>
Aug 08 23:38:09 user nova-compute[72405]:       </nova:ports>
Aug 08 23:38:09 user nova-compute[72405]:     </nova:instance>
Aug 08 23:38:09 user nova-compute[72405]:   </metadata>
Aug 08 23:38:09 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:38:09 user nova-compute[72405]:     <system>
Aug 08 23:38:09 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:38:09 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:38:09 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:38:09 user nova-compute[72405]:       <entry name="serial">74c3a8fc-fff0-422f-8583-142d7911e603</entry>
Aug 08 23:38:09 user nova-compute[72405]:       <entry name="uuid">74c3a8fc-fff0-422f-8583-142d7911e603</entry>
Aug 08 23:38:09 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:38:09 user nova-compute[72405]:     </system>
Aug 08 23:38:09 user nova-compute[72405]:   </sysinfo>
Aug 08 23:38:09 user nova-compute[72405]:   <os>
Aug 08 23:38:09 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:38:09 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:38:09 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:38:09 user nova-compute[72405]:   </os>
Aug 08 23:38:09 user nova-compute[72405]:   <features>
Aug 08 23:38:09 user nova-compute[72405]:     <acpi/>
Aug 08 23:38:09 user nova-compute[72405]:     <apic/>
Aug 08 23:38:09 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:38:09 user nova-compute[72405]:   </features>
Aug 08 23:38:09 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:38:09 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:38:09 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:38:09 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:38:09 user nova-compute[72405]:   </clock>
Aug 08 23:38:09 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:38:09 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:38:09 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:38:09 user nova-compute[72405]:   </cpu>
Aug 08 23:38:09 user nova-compute[72405]:   <devices>
Aug 08 23:38:09 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:38:09 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:38:09 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk"/>
Aug 08 23:38:09 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:38:09 user nova-compute[72405]:     </disk>
Aug 08 23:38:09 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:38:09 user nova-compute[72405]:       <mac address="fa:16:3e:9d:27:0f"/>
Aug 08 23:38:09 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:38:09 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:38:09 user nova-compute[72405]:       <target dev="tap5ccdec02-1d"/>
Aug 08 23:38:09 user nova-compute[72405]:     </interface>
Aug 08 23:38:09 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:38:09 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/console.log" append="off"/>
Aug 08 23:38:09 user nova-compute[72405]:     </serial>
Aug 08 23:38:09 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:38:09 user nova-compute[72405]:     <video>
Aug 08 23:38:09 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:38:09 user nova-compute[72405]:     </video>
Aug 08 23:38:09 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:38:09 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:38:09 user nova-compute[72405]:     </rng>
Aug 08 23:38:09 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:38:09 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:38:09 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:38:09 user nova-compute[72405]:     </memballoon>
Aug 08 23:38:09 user nova-compute[72405]:   </devices>
Aug 08 23:38:09 user nova-compute[72405]: </domain>
Aug 08 23:38:09 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-857807850',display_name='tempest-ServerRescueNegativeTestJSON-server-857807850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-857807850',id=36,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5brvflzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:05Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=74c3a8fc-fff0-422f-8583-142d7911e603,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG os_vif [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccdec02-1d, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ccdec02-1d, col_values=(('external_ids', {'iface-id': '5ccdec02-1dec-49f2-a61e-1f5f723aab05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:27:0f', 'vm-uuid': '74c3a8fc-fff0-422f-8583-142d7911e603'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: INFO os_vif [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d')
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:9d:27:0f, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updated VIF entry in instance network info cache for port 5ccdec02-1dec-49f2-a61e-1f5f723aab05. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-203b4da4-15f0-486a-98c2-8278d3048278 req-6f0046aa-953d-4035-9cd0-c2e2f77e25e2 service nova] Releasing lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd942482-edfa-40d7-b841-a67066cec518 req-d35e315a-20f0-4177-80eb-c9ad991b8af9 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd942482-edfa-40d7-b841-a67066cec518 req-d35e315a-20f0-4177-80eb-c9ad991b8af9 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd942482-edfa-40d7-b841-a67066cec518 req-d35e315a-20f0-4177-80eb-c9ad991b8af9 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bd942482-edfa-40d7-b841-a67066cec518 req-d35e315a-20f0-4177-80eb-c9ad991b8af9 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd942482-edfa-40d7-b841-a67066cec518 req-d35e315a-20f0-4177-80eb-c9ad991b8af9 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:11 user nova-compute[72405]: WARNING nova.compute.manager [req-bd942482-edfa-40d7-b841-a67066cec518 req-d35e315a-20f0-4177-80eb-c9ad991b8af9 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state building and task_state spawning.
Aug 08 23:38:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537891.9567082, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Resumed (Lifecycle Event)
Aug 08 23:38:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:38:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:38:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance spawned successfully.
Aug 08 23:38:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537891.9585922, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Started (Lifecycle Event)
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:12 user nova-compute[72405]: INFO nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Took 8.42 seconds to spawn the instance on the hypervisor.
Aug 08 23:38:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:38:12 user nova-compute[72405]: INFO nova.compute.manager [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Took 9.48 seconds to build instance.
Aug 08 23:38:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-825a902f-d3a6-4f8f-957a-a24ec7ef3a00 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.596s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:13 user nova-compute[72405]: WARNING nova.compute.manager [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state building and task_state spawning.
Aug 08 23:38:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:13 user nova-compute[72405]: WARNING nova.compute.manager [req-78aa3542-df1b-4a1e-a49d-451f99ac850a req-bcdba174-cda3-4af4-8bca-412bb96986f5 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state building and task_state spawning.
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537894.1589804, 74c3a8fc-fff0-422f-8583-142d7911e603 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] VM Resumed (Lifecycle Event)
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance spawned successfully.
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537894.1918676, 74c3a8fc-fff0-422f-8583-142d7911e603 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] VM Started (Lifecycle Event)
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:38:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Took 9.00 seconds to spawn the instance on the hypervisor.
Aug 08 23:38:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:14 user nova-compute[72405]: INFO nova.compute.manager [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Took 10.15 seconds to build instance.
Aug 08 23:38:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d8cbfbc4-41b6-4fdd-9beb-7e5f022f65a0 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.385s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:21 user nova-compute[72405]: INFO nova.compute.manager [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Terminating instance
Aug 08 23:38:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-37651fca-738c-4064-b7bf-577268d3cbc9 req-f19a8dd1-33bb-41d1-8bae-683685154b44 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-vif-unplugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-37651fca-738c-4064-b7bf-577268d3cbc9 req-f19a8dd1-33bb-41d1-8bae-683685154b44 service nova] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-37651fca-738c-4064-b7bf-577268d3cbc9 req-f19a8dd1-33bb-41d1-8bae-683685154b44 service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-37651fca-738c-4064-b7bf-577268d3cbc9 req-f19a8dd1-33bb-41d1-8bae-683685154b44 service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-37651fca-738c-4064-b7bf-577268d3cbc9 req-f19a8dd1-33bb-41d1-8bae-683685154b44 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] No waiting events found dispatching network-vif-unplugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-37651fca-738c-4064-b7bf-577268d3cbc9 req-f19a8dd1-33bb-41d1-8bae-683685154b44 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-vif-unplugged-d11416bb-91ee-4090-9062-1be48bc498f6 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:38:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Instance destroyed successfully.
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lazy-loading 'resources' on Instance uuid e86ae2e2-81b1-4ab8-add8-1b74187ae7db {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1955314979',display_name='tempest-VolumesActionsTest-instance-1955314979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1955314979',id=32,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:36:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2429c9eebe014d6f9bc61ff7b6cc68d4',ramdisk_id='',reservation_id='r-syheldks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-261489940',owner_user_name='tempest-VolumesActionsTest-261489940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:36:38Z,user_data=None,user_id='95d69553a04149d1a0a53ac53194db88',uuid=e86ae2e2-81b1-4ab8-add8-1b74187ae7db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converting VIF {"id": "d11416bb-91ee-4090-9062-1be48bc498f6", "address": "fa:16:3e:1d:d9:03", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11416bb-91", "ovs_interfaceid": "d11416bb-91ee-4090-9062-1be48bc498f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG os_vif [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd11416bb-91, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:38:22 user nova-compute[72405]: INFO os_vif [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d9:03,bridge_name='br-int',has_traffic_filtering=True,id=d11416bb-91ee-4090-9062-1be48bc498f6,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd11416bb-91')
Aug 08 23:38:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Deleting instance files /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db_del
Aug 08 23:38:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Deletion of /opt/stack/data/nova/instances/e86ae2e2-81b1-4ab8-add8-1b74187ae7db_del complete
Aug 08 23:38:22 user nova-compute[72405]: INFO nova.compute.manager [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 08 23:38:22 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:38:22 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:38:23 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:23 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Took 1.20 seconds to deallocate network for instance.
Aug 08 23:38:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-7546a11b-1ee3-4074-8dda-e61a3fc29f56 req-b4adb609-3bf4-46d8-b8cc-bf20fdd7340f service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-vif-deleted-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-560e9027-750a-42b5-b61b-ad6abdf7fa7b req-f4d4295b-329c-41aa-9a88-1f94944fe0e0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received event network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-560e9027-750a-42b5-b61b-ad6abdf7fa7b req-f4d4295b-329c-41aa-9a88-1f94944fe0e0 service nova] Acquiring lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-560e9027-750a-42b5-b61b-ad6abdf7fa7b req-f4d4295b-329c-41aa-9a88-1f94944fe0e0 service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-560e9027-750a-42b5-b61b-ad6abdf7fa7b req-f4d4295b-329c-41aa-9a88-1f94944fe0e0 service nova] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-560e9027-750a-42b5-b61b-ad6abdf7fa7b req-f4d4295b-329c-41aa-9a88-1f94944fe0e0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] No waiting events found dispatching network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:24 user nova-compute[72405]: WARNING nova.compute.manager [req-560e9027-750a-42b5-b61b-ad6abdf7fa7b req-f4d4295b-329c-41aa-9a88-1f94944fe0e0 service nova] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Received unexpected event network-vif-plugged-d11416bb-91ee-4090-9062-1be48bc498f6 for instance with vm_state deleted and task_state None.
Aug 08 23:38:24 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Deleted allocations for instance e86ae2e2-81b1-4ab8-add8-1b74187ae7db
Aug 08 23:38:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b387d7d5-219c-4a65-85ef-8eef208fc9d6 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "e86ae2e2-81b1-4ab8-add8-1b74187ae7db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:38:34 user nova-compute[72405]: INFO nova.compute.claims [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Claim successful on node user
Aug 08 23:38:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:38:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.policy [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea9b9cda387451ea9e40630216969bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e74c497139142c6bb15ba99d7277b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:38:34 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Creating image(s)
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "/opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "/opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk 1073741824" returned: 0 in 0.055s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Successfully created port: 04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Cannot resize image /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lazy-loading 'migration_context' on Instance uuid 5bdf41b1-5d1f-4911-a626-e21da4bedb0f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Ensure instance console log exists: /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Successfully updated port: 04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG nova.compute.manager [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-changed-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG nova.compute.manager [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Refreshing instance network info cache due to event network-changed-04e44c0b-eb42-4cb1-be94-413b762b740e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] Acquiring lock "refresh_cache-5bdf41b1-5d1f-4911-a626-e21da4bedb0f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] Acquired lock "refresh_cache-5bdf41b1-5d1f-4911-a626-e21da4bedb0f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG nova.network.neutron [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Refreshing network info cache for port 04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "refresh_cache-5bdf41b1-5d1f-4911-a626-e21da4bedb0f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:36 user nova-compute[72405]: DEBUG nova.network.neutron [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.neutron [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-493b5f6c-99d8-4e1a-a37d-73c750b66fcd req-6756de0c-a001-4752-896e-3dd7d1d06d84 service nova] Releasing lock "refresh_cache-5bdf41b1-5d1f-4911-a626-e21da4bedb0f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquired lock "refresh_cache-5bdf41b1-5d1f-4911-a626-e21da4bedb0f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537902.2849352, e86ae2e2-81b1-4ab8-add8-1b74187ae7db => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:37 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] VM Stopped (Lifecycle Event)
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-987fe95a-7c25-49ab-a28c-569b4c236f2b None None] [instance: e86ae2e2-81b1-4ab8-add8-1b74187ae7db] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Updating instance_info_cache with network_info: [{"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Releasing lock "refresh_cache-5bdf41b1-5d1f-4911-a626-e21da4bedb0f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Instance network_info: |[{"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Start _get_guest_xml network_info=[{"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:38:37 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:37 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-216512152',display_name='tempest-ServersNegativeTestJSON-server-216512152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-216512152',id=37,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e74c497139142c6bb15ba99d7277b8f',ramdisk_id='',reservation_id='r-fifl3zfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1093456984',owner_user_name='tempest-ServersNegativeTestJSON-1093456984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:35Z,user_data=None,user_id='fea9b9cda387451ea9e40630216969bb',uuid=5bdf41b1-5d1f-4911-a626-e21da4bedb0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converting VIF {"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bdf41b1-5d1f-4911-a626-e21da4bedb0f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:38:37 user nova-compute[72405]:   <uuid>5bdf41b1-5d1f-4911-a626-e21da4bedb0f</uuid>
Aug 08 23:38:37 user nova-compute[72405]:   <name>instance-00000025</name>
Aug 08 23:38:37 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:38:37 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:38:37 user nova-compute[72405]:   <metadata>
Aug 08 23:38:37 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:38:37 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:38:37 user nova-compute[72405]:       <nova:name>tempest-ServersNegativeTestJSON-server-216512152</nova:name>
Aug 08 23:38:37 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:38:37</nova:creationTime>
Aug 08 23:38:37 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:38:37 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:38:37 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:38:37 user nova-compute[72405]:       <nova:owner>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:user uuid="fea9b9cda387451ea9e40630216969bb">tempest-ServersNegativeTestJSON-1093456984-project-member</nova:user>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:project uuid="0e74c497139142c6bb15ba99d7277b8f">tempest-ServersNegativeTestJSON-1093456984</nova:project>
Aug 08 23:38:37 user nova-compute[72405]:       </nova:owner>
Aug 08 23:38:37 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:38:37 user nova-compute[72405]:       <nova:ports>
Aug 08 23:38:37 user nova-compute[72405]:         <nova:port uuid="04e44c0b-eb42-4cb1-be94-413b762b740e">
Aug 08 23:38:37 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 08 23:38:37 user nova-compute[72405]:         </nova:port>
Aug 08 23:38:37 user nova-compute[72405]:       </nova:ports>
Aug 08 23:38:37 user nova-compute[72405]:     </nova:instance>
Aug 08 23:38:37 user nova-compute[72405]:   </metadata>
Aug 08 23:38:37 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:38:37 user nova-compute[72405]:     <system>
Aug 08 23:38:37 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:38:37 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:38:37 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:38:37 user nova-compute[72405]:       <entry name="serial">5bdf41b1-5d1f-4911-a626-e21da4bedb0f</entry>
Aug 08 23:38:37 user nova-compute[72405]:       <entry name="uuid">5bdf41b1-5d1f-4911-a626-e21da4bedb0f</entry>
Aug 08 23:38:37 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:38:37 user nova-compute[72405]:     </system>
Aug 08 23:38:37 user nova-compute[72405]:   </sysinfo>
Aug 08 23:38:37 user nova-compute[72405]:   <os>
Aug 08 23:38:37 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:38:37 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:38:37 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:38:37 user nova-compute[72405]:   </os>
Aug 08 23:38:37 user nova-compute[72405]:   <features>
Aug 08 23:38:37 user nova-compute[72405]:     <acpi/>
Aug 08 23:38:37 user nova-compute[72405]:     <apic/>
Aug 08 23:38:37 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:38:37 user nova-compute[72405]:   </features>
Aug 08 23:38:37 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:38:37 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:38:37 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:38:37 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:38:37 user nova-compute[72405]:   </clock>
Aug 08 23:38:37 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:38:37 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:38:37 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:38:37 user nova-compute[72405]:   </cpu>
Aug 08 23:38:37 user nova-compute[72405]:   <devices>
Aug 08 23:38:37 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:38:37 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:38:37 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk"/>
Aug 08 23:38:37 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:38:37 user nova-compute[72405]:     </disk>
Aug 08 23:38:37 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:38:37 user nova-compute[72405]:       <mac address="fa:16:3e:7b:05:51"/>
Aug 08 23:38:37 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:38:37 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:38:37 user nova-compute[72405]:       <target dev="tap04e44c0b-eb"/>
Aug 08 23:38:37 user nova-compute[72405]:     </interface>
Aug 08 23:38:37 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:38:37 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/console.log" append="off"/>
Aug 08 23:38:37 user nova-compute[72405]:     </serial>
Aug 08 23:38:37 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:38:37 user nova-compute[72405]:     <video>
Aug 08 23:38:37 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:38:37 user nova-compute[72405]:     </video>
Aug 08 23:38:37 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:38:37 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:38:37 user nova-compute[72405]:     </rng>
Aug 08 23:38:37 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:38:37 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:38:37 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:38:37 user nova-compute[72405]:     </memballoon>
Aug 08 23:38:37 user nova-compute[72405]:   </devices>
Aug 08 23:38:37 user nova-compute[72405]: </domain>
Aug 08 23:38:37 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-216512152',display_name='tempest-ServersNegativeTestJSON-server-216512152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-216512152',id=37,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e74c497139142c6bb15ba99d7277b8f',ramdisk_id='',reservation_id='r-fifl3zfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1093456984',owner_user_name='tempest-ServersNegativeTestJSON-1093456984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:35Z,user_data=None,user_id='fea9b9cda387451ea9e40630216969bb',uuid=5bdf41b1-5d1f-4911-a626-e21da4bedb0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converting VIF {"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG os_vif [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04e44c0b-eb, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04e44c0b-eb, col_values=(('external_ids', {'iface-id': '04e44c0b-eb42-4cb1-be94-413b762b740e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:05:51', 'vm-uuid': '5bdf41b1-5d1f-4911-a626-e21da4bedb0f'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:37 user nova-compute[72405]: INFO os_vif [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb')
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:38:37 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] No VIF found with MAC fa:16:3e:7b:05:51, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-301c387f-1be4-4003-89a3-0f253f1bfd5f req-af586fc1-2bbd-4d17-bc28-ec7a4427a250 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-301c387f-1be4-4003-89a3-0f253f1bfd5f req-af586fc1-2bbd-4d17-bc28-ec7a4427a250 service nova] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-301c387f-1be4-4003-89a3-0f253f1bfd5f req-af586fc1-2bbd-4d17-bc28-ec7a4427a250 service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-301c387f-1be4-4003-89a3-0f253f1bfd5f req-af586fc1-2bbd-4d17-bc28-ec7a4427a250 service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-301c387f-1be4-4003-89a3-0f253f1bfd5f req-af586fc1-2bbd-4d17-bc28-ec7a4427a250 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] No waiting events found dispatching network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:39 user nova-compute[72405]: WARNING nova.compute.manager [req-301c387f-1be4-4003-89a3-0f253f1bfd5f req-af586fc1-2bbd-4d17-bc28-ec7a4427a250 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received unexpected event network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e for instance with vm_state building and task_state spawning.
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updating instance_info_cache with network_info: [{"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-baea144d-e0b9-484e-8898-1c2129ebb66e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-b216b1e2-611a-4636-9212-2590ad1201a6 req-245a7930-0550-4545-b4a1-6a5d6c18bc51 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b216b1e2-611a-4636-9212-2590ad1201a6 req-245a7930-0550-4545-b4a1-6a5d6c18bc51 service nova] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b216b1e2-611a-4636-9212-2590ad1201a6 req-245a7930-0550-4545-b4a1-6a5d6c18bc51 service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b216b1e2-611a-4636-9212-2590ad1201a6 req-245a7930-0550-4545-b4a1-6a5d6c18bc51 service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-b216b1e2-611a-4636-9212-2590ad1201a6 req-245a7930-0550-4545-b4a1-6a5d6c18bc51 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] No waiting events found dispatching network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:38:41 user nova-compute[72405]: WARNING nova.compute.manager [req-b216b1e2-611a-4636-9212-2590ad1201a6 req-245a7930-0550-4545-b4a1-6a5d6c18bc51 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received unexpected event network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e for instance with vm_state building and task_state spawning.
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537921.889179, 5bdf41b1-5d1f-4911-a626-e21da4bedb0f => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] VM Resumed (Lifecycle Event)
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:38:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Instance spawned successfully.
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537921.8927443, 5bdf41b1-5d1f-4911-a626-e21da4bedb0f => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:38:41 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] VM Started (Lifecycle Event)
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:38:42 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:38:42 user nova-compute[72405]: INFO nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Took 7.31 seconds to spawn the instance on the hypervisor.
Aug 08 23:38:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:38:42 user nova-compute[72405]: INFO nova.compute.manager [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Took 8.15 seconds to build instance.
Aug 08 23:38:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b9595da-66e4-475d-9b1e-082cf22e0586 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.255s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:38:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:38:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:38:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7299MB free_disk=25.125652313232422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:38:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:38:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance b410b764-3eab-40f1-9e27-81cefe78b0e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5bdf41b1-5d1f-4911-a626-e21da4bedb0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.861s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:38:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:38:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:38:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "eec0a761-1764-4d0a-be00-484278dfc865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:14 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:39:14 user nova-compute[72405]: INFO nova.compute.claims [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Claim successful on node user
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:39:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.policy [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95d69553a04149d1a0a53ac53194db88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2429c9eebe014d6f9bc61ff7b6cc68d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:39:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Creating image(s)
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "/opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "/opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "/opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk 1073741824" returned: 0 in 0.056s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Successfully created port: 40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Cannot resize image /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lazy-loading 'migration_context' on Instance uuid eec0a761-1764-4d0a-be00-484278dfc865 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Ensure instance console log exists: /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Successfully updated port: 40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "refresh_cache-eec0a761-1764-4d0a-be00-484278dfc865" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquired lock "refresh_cache-eec0a761-1764-4d0a-be00-484278dfc865" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-changed-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Refreshing instance network info cache due to event network-changed-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] Acquiring lock "refresh_cache-eec0a761-1764-4d0a-be00-484278dfc865" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Updating instance_info_cache with network_info: [{"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Releasing lock "refresh_cache-eec0a761-1764-4d0a-be00-484278dfc865" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Instance network_info: |[{"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] Acquired lock "refresh_cache-eec0a761-1764-4d0a-be00-484278dfc865" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Refreshing network info cache for port 40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Start _get_guest_xml network_info=[{"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:39:17 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:17 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1705977104',display_name='tempest-VolumesActionsTest-instance-1705977104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1705977104',id=38,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2429c9eebe014d6f9bc61ff7b6cc68d4',ramdisk_id='',reservation_id='r-e8lr27qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261489940',owner_user_name='tempest-VolumesActionsTest-261489940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:39:15Z,user_data=None,user_id='95d69553a04149d1a0a53ac53194db88',uuid=eec0a761-1764-4d0a-be00-484278dfc865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converting VIF {"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.objects.instance [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lazy-loading 'pci_devices' on Instance uuid eec0a761-1764-4d0a-be00-484278dfc865 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:39:17 user nova-compute[72405]:   <uuid>eec0a761-1764-4d0a-be00-484278dfc865</uuid>
Aug 08 23:39:17 user nova-compute[72405]:   <name>instance-00000026</name>
Aug 08 23:39:17 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:39:17 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:39:17 user nova-compute[72405]:   <metadata>
Aug 08 23:39:17 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:39:17 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:39:17 user nova-compute[72405]:       <nova:name>tempest-VolumesActionsTest-instance-1705977104</nova:name>
Aug 08 23:39:17 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:39:17</nova:creationTime>
Aug 08 23:39:17 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:39:17 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:39:17 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:39:17 user nova-compute[72405]:       <nova:owner>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:user uuid="95d69553a04149d1a0a53ac53194db88">tempest-VolumesActionsTest-261489940-project-member</nova:user>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:project uuid="2429c9eebe014d6f9bc61ff7b6cc68d4">tempest-VolumesActionsTest-261489940</nova:project>
Aug 08 23:39:17 user nova-compute[72405]:       </nova:owner>
Aug 08 23:39:17 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:39:17 user nova-compute[72405]:       <nova:ports>
Aug 08 23:39:17 user nova-compute[72405]:         <nova:port uuid="40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c">
Aug 08 23:39:17 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:39:17 user nova-compute[72405]:         </nova:port>
Aug 08 23:39:17 user nova-compute[72405]:       </nova:ports>
Aug 08 23:39:17 user nova-compute[72405]:     </nova:instance>
Aug 08 23:39:17 user nova-compute[72405]:   </metadata>
Aug 08 23:39:17 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:39:17 user nova-compute[72405]:     <system>
Aug 08 23:39:17 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:39:17 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:39:17 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:39:17 user nova-compute[72405]:       <entry name="serial">eec0a761-1764-4d0a-be00-484278dfc865</entry>
Aug 08 23:39:17 user nova-compute[72405]:       <entry name="uuid">eec0a761-1764-4d0a-be00-484278dfc865</entry>
Aug 08 23:39:17 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:39:17 user nova-compute[72405]:     </system>
Aug 08 23:39:17 user nova-compute[72405]:   </sysinfo>
Aug 08 23:39:17 user nova-compute[72405]:   <os>
Aug 08 23:39:17 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:39:17 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:39:17 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:39:17 user nova-compute[72405]:   </os>
Aug 08 23:39:17 user nova-compute[72405]:   <features>
Aug 08 23:39:17 user nova-compute[72405]:     <acpi/>
Aug 08 23:39:17 user nova-compute[72405]:     <apic/>
Aug 08 23:39:17 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:39:17 user nova-compute[72405]:   </features>
Aug 08 23:39:17 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:39:17 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:39:17 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:39:17 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:39:17 user nova-compute[72405]:   </clock>
Aug 08 23:39:17 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:39:17 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:39:17 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:39:17 user nova-compute[72405]:   </cpu>
Aug 08 23:39:17 user nova-compute[72405]:   <devices>
Aug 08 23:39:17 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:39:17 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:39:17 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk"/>
Aug 08 23:39:17 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:39:17 user nova-compute[72405]:     </disk>
Aug 08 23:39:17 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:39:17 user nova-compute[72405]:       <mac address="fa:16:3e:c4:51:5b"/>
Aug 08 23:39:17 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:39:17 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:39:17 user nova-compute[72405]:       <target dev="tap40a8b63b-d4"/>
Aug 08 23:39:17 user nova-compute[72405]:     </interface>
Aug 08 23:39:17 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:39:17 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/console.log" append="off"/>
Aug 08 23:39:17 user nova-compute[72405]:     </serial>
Aug 08 23:39:17 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:39:17 user nova-compute[72405]:     <video>
Aug 08 23:39:17 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:39:17 user nova-compute[72405]:     </video>
Aug 08 23:39:17 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:39:17 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:39:17 user nova-compute[72405]:     </rng>
Aug 08 23:39:17 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:39:17 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:39:17 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:39:17 user nova-compute[72405]:     </memballoon>
Aug 08 23:39:17 user nova-compute[72405]:   </devices>
Aug 08 23:39:17 user nova-compute[72405]: </domain>
Aug 08 23:39:17 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1705977104',display_name='tempest-VolumesActionsTest-instance-1705977104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1705977104',id=38,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2429c9eebe014d6f9bc61ff7b6cc68d4',ramdisk_id='',reservation_id='r-e8lr27qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261489940',owner_user_name='tempest-VolumesActionsTest-261489940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:39:15Z,user_data=None,user_id='95d69553a04149d1a0a53ac53194db88',uuid=eec0a761-1764-4d0a-be00-484278dfc865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converting VIF {"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG os_vif [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40a8b63b-d4, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40a8b63b-d4, col_values=(('external_ids', {'iface-id': '40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:51:5b', 'vm-uuid': 'eec0a761-1764-4d0a-be00-484278dfc865'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:17 user nova-compute[72405]: INFO os_vif [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4')
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:39:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] No VIF found with MAC fa:16:3e:c4:51:5b, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:39:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Updated VIF entry in instance network info cache for port 40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:39:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Updating instance_info_cache with network_info: [{"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-07c50154-385a-463c-ba2d-c7a01b9e94ed req-55a563b0-e595-424d-aa15-c658f551ddaa service nova] Releasing lock "refresh_cache-eec0a761-1764-4d0a-be00-484278dfc865" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-5b5a929a-b930-45b2-90a4-47af7b3b64da req-0043ccb4-d686-43f7-adc8-6e750409638a service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5b5a929a-b930-45b2-90a4-47af7b3b64da req-0043ccb4-d686-43f7-adc8-6e750409638a service nova] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5b5a929a-b930-45b2-90a4-47af7b3b64da req-0043ccb4-d686-43f7-adc8-6e750409638a service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5b5a929a-b930-45b2-90a4-47af7b3b64da req-0043ccb4-d686-43f7-adc8-6e750409638a service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-5b5a929a-b930-45b2-90a4-47af7b3b64da req-0043ccb4-d686-43f7-adc8-6e750409638a service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] No waiting events found dispatching network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:19 user nova-compute[72405]: WARNING nova.compute.manager [req-5b5a929a-b930-45b2-90a4-47af7b3b64da req-0043ccb4-d686-43f7-adc8-6e750409638a service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received unexpected event network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c for instance with vm_state building and task_state spawning.
Aug 08 23:39:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537961.5854118, eec0a761-1764-4d0a-be00-484278dfc865 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] VM Resumed (Lifecycle Event)
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Instance spawned successfully.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid baea144d-e0b9-484e-8898-1c2129ebb66e {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 5bdf41b1-5d1f-4911-a626-e21da4bedb0f {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid eec0a761-1764-4d0a-be00-484278dfc865 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691537961.5877845, eec0a761-1764-4d0a-be00-484278dfc865 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] VM Started (Lifecycle Event)
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-3b81f0e7-d42a-4515-b811-33845b4aa0e7 req-601d2541-fe3e-4cd1-ba99-dcea54d7c275 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3b81f0e7-d42a-4515-b811-33845b4aa0e7 req-601d2541-fe3e-4cd1-ba99-dcea54d7c275 service nova] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3b81f0e7-d42a-4515-b811-33845b4aa0e7 req-601d2541-fe3e-4cd1-ba99-dcea54d7c275 service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3b81f0e7-d42a-4515-b811-33845b4aa0e7 req-601d2541-fe3e-4cd1-ba99-dcea54d7c275 service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-3b81f0e7-d42a-4515-b811-33845b4aa0e7 req-601d2541-fe3e-4cd1-ba99-dcea54d7c275 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] No waiting events found dispatching network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:21 user nova-compute[72405]: WARNING nova.compute.manager [req-3b81f0e7-d42a-4515-b811-33845b4aa0e7 req-601d2541-fe3e-4cd1-ba99-dcea54d7c275 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received unexpected event network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c for instance with vm_state building and task_state spawning.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.170s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Took 7.30 seconds to build instance.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92d13fae-a673-4384-9b80-e1c4ec86f32f tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "eec0a761-1764-4d0a-be00-484278dfc865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.402s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "eec0a761-1764-4d0a-be00-484278dfc865" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.274s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:21 user nova-compute[72405]: INFO nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:39:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "eec0a761-1764-4d0a-be00-484278dfc865" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-changed-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Refreshing instance network info cache due to event network-changed-eac5523e-985c-4a32-b6a6-b75f08a00cf9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:39:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:23 user nova-compute[72405]: DEBUG nova.network.neutron [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Refreshing network info cache for port eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updated VIF entry in instance network info cache for port eac5523e-985c-4a32-b6a6-b75f08a00cf9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-changed-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Refreshing instance network info cache due to event network-changed-27b2fc0e-b8bc-451c-89ed-5be2550f0e80. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Refreshing network info cache for port 27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:39:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.network.neutron [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updated VIF entry in instance network info cache for port 27b2fc0e-b8bc-451c-89ed-5be2550f0e80. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.network.neutron [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8d9519f9-7bac-44ba-a4c8-3607c0a3f979 req-feb3c9d9-96f9-49e7-8c2f-2b64ea5fe6e6 service nova] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Stashing vm_state: active {{(pid=72405) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'pci_requests' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:39:25 user nova-compute[72405]: INFO nova.compute.claims [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Claim successful on node user
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'resources' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'pci_devices' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:25 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating resource usage from migration 95c0544a-6715-47b1-8fc5-63082daa06c6
Aug 08 23:39:26 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:39:26 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:39:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.750s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:26 user nova-compute[72405]: INFO nova.compute.manager [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Migrating
Aug 08 23:39:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:26 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:39:27 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Starting migrate_disk_and_power_off {{(pid=72405) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-84118344-aa76-436a-92f9-0cd839f38063 req-1337123c-2514-4a69-8577-e261f9af0dad service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84118344-aa76-436a-92f9-0cd839f38063 req-1337123c-2514-4a69-8577-e261f9af0dad service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84118344-aa76-436a-92f9-0cd839f38063 req-1337123c-2514-4a69-8577-e261f9af0dad service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-84118344-aa76-436a-92f9-0cd839f38063 req-1337123c-2514-4a69-8577-e261f9af0dad service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-84118344-aa76-436a-92f9-0cd839f38063 req-1337123c-2514-4a69-8577-e261f9af0dad service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:28 user nova-compute[72405]: WARNING nova.compute.manager [req-84118344-aa76-436a-92f9-0cd839f38063 req-1337123c-2514-4a69-8577-e261f9af0dad service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance destroyed successfully.
Aug 08 23:39:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-20453789',display_name='tempest-ServerActionsTestOtherA-server-20453789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-20453789',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-1ub2fet6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=855c4ef2-9d79-4495-8dd4-21b8ae09e04f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b2fc0e-b8, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:39:28 user nova-compute[72405]: INFO os_vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8')
Aug 08 23:39:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:39:28 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e3b6ba-b3c7-42a7-bf2d-6ccf472f8c32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa7a1b-b8bd-4978-a1e9-52f40c60ec97]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:28 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:39:28 user nova-compute[72405]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:39:28 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:28 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:39:28 user nova-compute[72405]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:39:28 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f2edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[402081c9-8907-43d6-a542-c7ccc3fc6108]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[56011ab2-13e3-4b06-8f12-60f8cdbde730]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478e944-a275-431d-9a34-e3b19f151531]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:39:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a77a0-e7e7-4a55-a2aa-8e5ea9172804]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c7e002-175b-4b23-8c37-55a2ae9e413a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.235s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14489e75-cca6-4b57-ba68-c88598b61464]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]
Aug 08 23:39:29 user nova-compute[72405]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.
Aug 08 23:39:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[54651dc9-7836-4d07-8952-3e81f115cb5c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.532s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== disconnect_volume: return (534ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:30 user nova-compute[72405]: WARNING nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:30 user nova-compute[72405]: WARNING nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:30 user nova-compute[72405]: WARNING nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:30 user nova-compute[72405]: WARNING nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:30 user nova-compute[72405]: WARNING nova.compute.manager [req-ac06aee7-515c-4da4-8cba-5de48e5157b9 req-3207c52d-3859-47c0-958f-36907f659fa7 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_migrating.
Aug 08 23:39:30 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Port 27b2fc0e-b8bc-451c-89ed-5be2550f0e80 binding to destination host user is already ACTIVE {{(pid=72405) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG os_brick.utils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d984b78-caa9-4c58-83e4-24e49809111e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba5d74d-879d-43db-88af-41609ac6367c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cce4821-ffb3-4c7d-855e-cc5e99008322]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e357de39-5a69-4151-89ae-46ec67f4d080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:31 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:39:32 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:39:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d7cc9-c119-4b11-b37e-cc44ba7ef4ae]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:39:32 user nova-compute[72405]: DEBUG os_brick.utils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:39:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:39:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:39:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating instance_info_cache with network_info: [{"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-b410b764-3eab-40f1-9e27-81cefe78b0e3" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:39:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537968.7473285, 855c4ef2-9d79-4495-8dd4-21b8ae09e04f => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:39:43 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] VM Stopped (Lifecycle Event)
Aug 08 23:39:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1590b47c-3884-46f9-b764-66e7206e0585 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1590b47c-3884-46f9-b764-66e7206e0585 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:39:43 user nova-compute[72405]: INFO nova.compute.manager [None req-1590b47c-3884-46f9-b764-66e7206e0585 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7277MB free_disk=25.039554595947266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Applying migration context for instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f as it has an incoming, in-progress migration 95c0544a-6715-47b1-8fc5-63082daa06c6. Migration status is post-migrating {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 08 23:39:47 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating resource usage from migration 95c0544a-6715-47b1-8fc5-63082daa06c6
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance baea144d-e0b9-484e-8898-1c2129ebb66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance b410b764-3eab-40f1-9e27-81cefe78b0e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5bdf41b1-5d1f-4911-a626-e21da4bedb0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance eec0a761-1764-4d0a-be00-484278dfc865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Migration 95c0544a-6715-47b1-8fc5-63082daa06c6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:47 user nova-compute[72405]: INFO nova.compute.manager [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Terminating instance
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-5473701c-d87e-4b91-977d-0bd0cba65e41 req-615b0f86-e2bd-401c-a969-443046f715c5 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5473701c-d87e-4b91-977d-0bd0cba65e41 req-615b0f86-e2bd-401c-a969-443046f715c5 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5473701c-d87e-4b91-977d-0bd0cba65e41 req-615b0f86-e2bd-401c-a969-443046f715c5 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5473701c-d87e-4b91-977d-0bd0cba65e41 req-615b0f86-e2bd-401c-a969-443046f715c5 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-5473701c-d87e-4b91-977d-0bd0cba65e41 req-615b0f86-e2bd-401c-a969-443046f715c5 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:47 user nova-compute[72405]: DEBUG nova.compute.manager [req-5473701c-d87e-4b91-977d-0bd0cba65e41 req-615b0f86-e2bd-401c-a969-443046f715c5 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-unplugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:39:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Instance destroyed successfully.
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'resources' on Instance uuid b410b764-3eab-40f1-9e27-81cefe78b0e3 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-859653112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-859653112',id=31,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-9o558hjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:38:02Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=b410b764-3eab-40f1-9e27-81cefe78b0e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "607ff757-39b7-4fab-b733-a5866fa0709c", "address": "fa:16:3e:11:0a:0b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607ff757-39", "ovs_interfaceid": "607ff757-39b7-4fab-b733-a5866fa0709c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_vif [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap607ff757-39, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:39:48 user nova-compute[72405]: INFO os_vif [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:0a:0b,bridge_name='br-int',has_traffic_filtering=True,id=607ff757-39b7-4fab-b733-a5866fa0709c,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607ff757-39')
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUwCPYgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:39:48 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[452f0301-84ee-4243-b3a9-643acf94bf5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb697966-e2ca-422a-87ea-0b2e19ad1979]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:39:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:48 user nova-compute[72405]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 (non-flash)
Aug 08 23:39:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9c956710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92'): ({'sdf'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Removing single pathed devices sdf {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc15b7-bea2-406e-930a-f0fd688223ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9745fcce-ef9f-4b47-8979-ff42e99f5f3a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flushing IO for device /dev/sdf {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b471d-55d4-4d7d-af79-d283886ef9ee]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07b542b-fecc-4b7e-802c-f896f7eaf98a]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] SCSI volumes sdf have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1c9e7b20', '/dev/disk/by-id/scsi-1SCST_BIO1c9e7b20-ede4d25aea5be1c4', '/dev/disk/by-id/scsi-26564653464323561') {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:39:48 user nova-compute[72405]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1c9e7b20
Aug 08 23:39:48 user nova-compute[72405]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1c9e7b20-ede4d25aea5be1c4
Aug 08 23:39:48 user nova-compute[72405]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26564653464323561
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d312f-e817-454b-811a-c332a02c174f]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e1f911-dedd-4fd2-bcd6-62aceef9646a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468a084-9fbe-458f-a104-d3ff90f08a82]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260]
Aug 08 23:39:48 user nova-compute[72405]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92, portal: 172.16.0.220,3260] successful.
Aug 08 23:39:48 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d20d2dc-a7a5-4a7d-9915-b4981a666d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f35d8-1198-4efd-8cc1-d71031c34551]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== disconnect_volume: return (312ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:39:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Deleting instance files /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3_del
Aug 08 23:39:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Deletion of /opt/stack/data/nova/instances/b410b764-3eab-40f1-9e27-81cefe78b0e3_del complete
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:39:48 user nova-compute[72405]: INFO nova.compute.manager [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 08 23:39:48 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:39:48 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:49 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Took 0.56 seconds to deallocate network for instance.
Aug 08 23:39:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-47f2332a-8676-4eaa-9b1e-d9ae1351b56e req-e6a1479d-53a0-4f0c-a511-1bdebda06819 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-deleted-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-906328a0-6c4a-4846-bd0a-60a33fdd72d0 req-69835ab9-91b7-4522-ad35-388a153781d0 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-906328a0-6c4a-4846-bd0a-60a33fdd72d0 req-69835ab9-91b7-4522-ad35-388a153781d0 service nova] Acquiring lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-906328a0-6c4a-4846-bd0a-60a33fdd72d0 req-69835ab9-91b7-4522-ad35-388a153781d0 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-906328a0-6c4a-4846-bd0a-60a33fdd72d0 req-69835ab9-91b7-4522-ad35-388a153781d0 service nova] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-906328a0-6c4a-4846-bd0a-60a33fdd72d0 req-69835ab9-91b7-4522-ad35-388a153781d0 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] No waiting events found dispatching network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:49 user nova-compute[72405]: WARNING nova.compute.manager [req-906328a0-6c4a-4846-bd0a-60a33fdd72d0 req-69835ab9-91b7-4522-ad35-388a153781d0 service nova] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Received unexpected event network-vif-plugged-607ff757-39b7-4fab-b733-a5866fa0709c for instance with vm_state active and task_state deleting.
Aug 08 23:39:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:54 user nova-compute[72405]: INFO nova.compute.manager [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Rescuing
Aug 08 23:39:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-dedcd3f1-4066-4e87-b512-3fa9da11d18b req-a2284da3-189e-448f-93dc-ce7378279d43 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dedcd3f1-4066-4e87-b512-3fa9da11d18b req-a2284da3-189e-448f-93dc-ce7378279d43 service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dedcd3f1-4066-4e87-b512-3fa9da11d18b req-a2284da3-189e-448f-93dc-ce7378279d43 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dedcd3f1-4066-4e87-b512-3fa9da11d18b req-a2284da3-189e-448f-93dc-ce7378279d43 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-dedcd3f1-4066-4e87-b512-3fa9da11d18b req-a2284da3-189e-448f-93dc-ce7378279d43 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:55 user nova-compute[72405]: WARNING nova.compute.manager [req-dedcd3f1-4066-4e87-b512-3fa9da11d18b req-a2284da3-189e-448f-93dc-ce7378279d43 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Starting finish_migration {{(pid=72405) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:39:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Creating image(s)
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Ensure instance console log exists: /opt/stack/data/nova/instances/855c4ef2-9d79-4495-8dd4-21b8ae09e04f/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Start _get_guest_xml network_info=[{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea36d52a-d048-466a-af9a-c1c5f74164e9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '855c4ef2-9d79-4495-8dd4-21b8ae09e04f', 'attached_at': '2023-08-08T23:39:55.000000', 'detached_at': '', 'volume_id': 'e3a0cb73-0e44-4b84-a140-fabe8da72e62', 'serial': 'e3a0cb73-0e44-4b84-a140-fabe8da72e62'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance destroyed successfully.
Aug 08 23:39:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:39:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Attempting rescue
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72405) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'vcpu_model' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:39:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Creating image(s)
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'trusted_certs' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:39:55 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:39:55 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:39:55 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6014ca89-8e5c-4257-8339-46d4ce7801ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:39:55 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89bb8fc-1c82-4932-83b4-399337b3a15f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62] added
Aug 08 23:39:55 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[88daef43-b499-4438-b8f0-1c8280ba96a0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef00e12e-75e3-4ecb-abe7-370356236799]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBoSZEHU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBoSZEHU" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c7cf9-ddc6-4afb-9aee-f3609fcc5d9d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBoSZEHU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab57f8d-b378-46cd-b892-fa3feeb17f80]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue" returned: 0 in 0.058s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'migration_context' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b845a6-7bda-4cf3-a7de-e49934daf14d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Start _get_guest_xml network_info=[{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:9d:27:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'resources' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'numa_topology' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:56 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:56 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'vcpu_model' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016c89e-cd44-4ae7-a29e-226ccd33e669]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]
Aug 08 23:39:56 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.
Aug 08 23:39:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-857807850',display_name='tempest-ServerRescueNegativeTestJSON-server-857807850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-857807850',id=36,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5brvflzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:14Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=74c3a8fc-fff0-422f-8583-142d7911e603,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:9d:27:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:9d:27:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'pci_devices' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b2355d-8e18-4659-9c1a-587bd51cbf88]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:39:56 user nova-compute[72405]:   <uuid>74c3a8fc-fff0-422f-8583-142d7911e603</uuid>
Aug 08 23:39:56 user nova-compute[72405]:   <name>instance-00000024</name>
Aug 08 23:39:56 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:39:56 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:39:56 user nova-compute[72405]:   <metadata>
Aug 08 23:39:56 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:39:56 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:39:56 user nova-compute[72405]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-857807850</nova:name>
Aug 08 23:39:56 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:39:56</nova:creationTime>
Aug 08 23:39:56 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:39:56 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:39:56 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:39:56 user nova-compute[72405]:       <nova:owner>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:user uuid="94a805b078b640c29ae13aabfd1fd5a5">tempest-ServerRescueNegativeTestJSON-297666519-project-member</nova:user>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:project uuid="93111863a9dc43b9a50c61a6c1f4c52c">tempest-ServerRescueNegativeTestJSON-297666519</nova:project>
Aug 08 23:39:56 user nova-compute[72405]:       </nova:owner>
Aug 08 23:39:56 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:39:56 user nova-compute[72405]:       <nova:ports>
Aug 08 23:39:56 user nova-compute[72405]:         <nova:port uuid="5ccdec02-1dec-49f2-a61e-1f5f723aab05">
Aug 08 23:39:56 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 08 23:39:56 user nova-compute[72405]:         </nova:port>
Aug 08 23:39:56 user nova-compute[72405]:       </nova:ports>
Aug 08 23:39:56 user nova-compute[72405]:     </nova:instance>
Aug 08 23:39:56 user nova-compute[72405]:   </metadata>
Aug 08 23:39:56 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:39:56 user nova-compute[72405]:     <system>
Aug 08 23:39:56 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:39:56 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:39:56 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:39:56 user nova-compute[72405]:       <entry name="serial">74c3a8fc-fff0-422f-8583-142d7911e603</entry>
Aug 08 23:39:56 user nova-compute[72405]:       <entry name="uuid">74c3a8fc-fff0-422f-8583-142d7911e603</entry>
Aug 08 23:39:56 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:39:56 user nova-compute[72405]:     </system>
Aug 08 23:39:56 user nova-compute[72405]:   </sysinfo>
Aug 08 23:39:56 user nova-compute[72405]:   <os>
Aug 08 23:39:56 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:39:56 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:39:56 user nova-compute[72405]:   </os>
Aug 08 23:39:56 user nova-compute[72405]:   <features>
Aug 08 23:39:56 user nova-compute[72405]:     <acpi/>
Aug 08 23:39:56 user nova-compute[72405]:     <apic/>
Aug 08 23:39:56 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:39:56 user nova-compute[72405]:   </features>
Aug 08 23:39:56 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:39:56 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:39:56 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:39:56 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:39:56 user nova-compute[72405]:   </clock>
Aug 08 23:39:56 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:39:56 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:39:56 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:39:56 user nova-compute[72405]:   </cpu>
Aug 08 23:39:56 user nova-compute[72405]:   <devices>
Aug 08 23:39:56 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:39:56 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:39:56 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue"/>
Aug 08 23:39:56 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:39:56 user nova-compute[72405]:     </disk>
Aug 08 23:39:56 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:39:56 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:39:56 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk"/>
Aug 08 23:39:56 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:39:56 user nova-compute[72405]:     </disk>
Aug 08 23:39:56 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:39:56 user nova-compute[72405]:       <mac address="fa:16:3e:9d:27:0f"/>
Aug 08 23:39:56 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:39:56 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:39:56 user nova-compute[72405]:       <target dev="tap5ccdec02-1d"/>
Aug 08 23:39:56 user nova-compute[72405]:     </interface>
Aug 08 23:39:56 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:39:56 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/console.log" append="off"/>
Aug 08 23:39:56 user nova-compute[72405]:     </serial>
Aug 08 23:39:56 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:39:56 user nova-compute[72405]:     <video>
Aug 08 23:39:56 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:39:56 user nova-compute[72405]:     </video>
Aug 08 23:39:56 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:39:56 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:39:56 user nova-compute[72405]:     </rng>
Aug 08 23:39:56 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:39:56 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:39:56 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:39:56 user nova-compute[72405]:     </memballoon>
Aug 08 23:39:56 user nova-compute[72405]:   </devices>
Aug 08 23:39:56 user nova-compute[72405]: </domain>
Aug 08 23:39:56 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3d2d9b-d954-4fdb-9187-52f837b8e224]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:56 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:39:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:39:56 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:39:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:39:56 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance destroyed successfully.
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa48469-a8d8-4de6-9f5f-87bf7d28a032]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:9d:27:0f, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:39:56 user nova-compute[72405]: INFO nova.compute.manager [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Took 7.70 seconds to detach 1 volumes for instance.
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:57 user nova-compute[72405]: WARNING nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:57 user nova-compute[72405]: WARNING nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:57 user nova-compute[72405]: WARNING nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:57 user nova-compute[72405]: WARNING nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:57 user nova-compute[72405]: WARNING nova.compute.manager [req-2ad7fde2-2cad-470d-bd52-7b3d6fa4c3e5 req-cba63422-9de6-4e64-b22d-128068e2656c service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '23130353134386239', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353134386239', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-20453789',display_name='tempest-ServerActionsTestOtherA-server-20453789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-20453789',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-1ub2fet6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=855c4ef2-9d79-4495-8dd4-21b8ae09e04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:39:57 user nova-compute[72405]:   <uuid>855c4ef2-9d79-4495-8dd4-21b8ae09e04f</uuid>
Aug 08 23:39:57 user nova-compute[72405]:   <name>instance-00000022</name>
Aug 08 23:39:57 user nova-compute[72405]:   <memory>2097152</memory>
Aug 08 23:39:57 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:39:57 user nova-compute[72405]:   <metadata>
Aug 08 23:39:57 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:39:57 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:39:57 user nova-compute[72405]:       <nova:name>tempest-ServerActionsTestOtherA-server-20453789</nova:name>
Aug 08 23:39:57 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:39:55</nova:creationTime>
Aug 08 23:39:57 user nova-compute[72405]:       <nova:flavor name="m1.small">
Aug 08 23:39:57 user nova-compute[72405]:         <nova:memory>2048</nova:memory>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:disk>20</nova:disk>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:39:57 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:39:57 user nova-compute[72405]:       <nova:owner>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:user uuid="f2e4ec54172a455187e10b1b119c8cec">tempest-ServerActionsTestOtherA-1743133349-project-member</nova:user>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:project uuid="628adffbe7ca403b8dc9c26f8254cddb">tempest-ServerActionsTestOtherA-1743133349</nova:project>
Aug 08 23:39:57 user nova-compute[72405]:       </nova:owner>
Aug 08 23:39:57 user nova-compute[72405]:       <nova:ports>
Aug 08 23:39:57 user nova-compute[72405]:         <nova:port uuid="27b2fc0e-b8bc-451c-89ed-5be2550f0e80">
Aug 08 23:39:57 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:39:57 user nova-compute[72405]:         </nova:port>
Aug 08 23:39:57 user nova-compute[72405]:       </nova:ports>
Aug 08 23:39:57 user nova-compute[72405]:     </nova:instance>
Aug 08 23:39:57 user nova-compute[72405]:   </metadata>
Aug 08 23:39:57 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:39:57 user nova-compute[72405]:     <system>
Aug 08 23:39:57 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:39:57 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:39:57 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:39:57 user nova-compute[72405]:       <entry name="serial">855c4ef2-9d79-4495-8dd4-21b8ae09e04f</entry>
Aug 08 23:39:57 user nova-compute[72405]:       <entry name="uuid">855c4ef2-9d79-4495-8dd4-21b8ae09e04f</entry>
Aug 08 23:39:57 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:39:57 user nova-compute[72405]:     </system>
Aug 08 23:39:57 user nova-compute[72405]:   </sysinfo>
Aug 08 23:39:57 user nova-compute[72405]:   <os>
Aug 08 23:39:57 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:39:57 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:39:57 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:39:57 user nova-compute[72405]:   </os>
Aug 08 23:39:57 user nova-compute[72405]:   <features>
Aug 08 23:39:57 user nova-compute[72405]:     <acpi/>
Aug 08 23:39:57 user nova-compute[72405]:     <apic/>
Aug 08 23:39:57 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:39:57 user nova-compute[72405]:   </features>
Aug 08 23:39:57 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:39:57 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:39:57 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:39:57 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:39:57 user nova-compute[72405]:   </clock>
Aug 08 23:39:57 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:39:57 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:39:57 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:39:57 user nova-compute[72405]:   </cpu>
Aug 08 23:39:57 user nova-compute[72405]:   <devices>
Aug 08 23:39:57 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:39:57 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:39:57 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:39:57 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:39:57 user nova-compute[72405]:       <serial>e3a0cb73-0e44-4b84-a140-fabe8da72e62</serial>
Aug 08 23:39:57 user nova-compute[72405]:     </disk>
Aug 08 23:39:57 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:39:57 user nova-compute[72405]:       <mac address="fa:16:3e:e7:e9:e5"/>
Aug 08 23:39:57 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:39:57 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:39:57 user nova-compute[72405]:       <target dev="tap27b2fc0e-b8"/>
Aug 08 23:39:57 user nova-compute[72405]:     </interface>
Aug 08 23:39:57 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:39:57 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/855c4ef2-9d79-4495-8dd4-21b8ae09e04f/console.log" append="off"/>
Aug 08 23:39:57 user nova-compute[72405]:     </serial>
Aug 08 23:39:57 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:39:57 user nova-compute[72405]:     <video>
Aug 08 23:39:57 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:39:57 user nova-compute[72405]:     </video>
Aug 08 23:39:57 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:39:57 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:39:57 user nova-compute[72405]:     </rng>
Aug 08 23:39:57 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:39:57 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:39:57 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:39:57 user nova-compute[72405]:     </memballoon>
Aug 08 23:39:57 user nova-compute[72405]:   </devices>
Aug 08 23:39:57 user nova-compute[72405]: </domain>
Aug 08 23:39:57 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-20453789',display_name='tempest-ServerActionsTestOtherA-server-20453789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-20453789',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-1ub2fet6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=855c4ef2-9d79-4495-8dd4-21b8ae09e04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1330158064-network", "vif_mac": "fa:16:3e:e7:e9:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG os_vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b2fc0e-b8, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27b2fc0e-b8, col_values=(('external_ids', {'iface-id': '27b2fc0e-b8bc-451c-89ed-5be2550f0e80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:e9:e5', 'vm-uuid': '855c4ef2-9d79-4495-8dd4-21b8ae09e04f'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:57 user nova-compute[72405]: INFO os_vif [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8')
Aug 08 23:39:57 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Deleted allocations for instance b410b764-3eab-40f1-9e27-81cefe78b0e3
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] No VIF found with MAC fa:16:3e:e7:e9:e5, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a2524ed2-8d76-48b3-b3af-44740c85620c tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "b410b764-3eab-40f1-9e27-81cefe78b0e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.270s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:59 user nova-compute[72405]: WARNING nova.compute.manager [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:59 user nova-compute[72405]: WARNING nova.compute.manager [req-392506e7-8ac2-4429-906f-58dc39482640 req-931015e2-729e-4a88-b6a6-b423ea01fb99 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state active and task_state rescuing.
Aug 08 23:39:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e508023-da09-42ad-9857-d94b37336f16 req-c2f74174-0c6b-4939-a601-4957aa2b3287 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e508023-da09-42ad-9857-d94b37336f16 req-c2f74174-0c6b-4939-a601-4957aa2b3287 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e508023-da09-42ad-9857-d94b37336f16 req-c2f74174-0c6b-4939-a601-4957aa2b3287 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4e508023-da09-42ad-9857-d94b37336f16 req-c2f74174-0c6b-4939-a601-4957aa2b3287 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:39:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-4e508023-da09-42ad-9857-d94b37336f16 req-c2f74174-0c6b-4939-a601-4957aa2b3287 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:39:59 user nova-compute[72405]: WARNING nova.compute.manager [req-4e508023-da09-42ad-9857-d94b37336f16 req-c2f74174-0c6b-4939-a601-4957aa2b3287 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_finish.
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 74c3a8fc-fff0-422f-8583-142d7911e603 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538001.5019035, 74c3a8fc-fff0-422f-8583-142d7911e603 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] VM Resumed (Lifecycle Event)
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b5ddead1-bc31-417e-847d-8eed8631a8b4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538001.5063922, 74c3a8fc-fff0-422f-8583-142d7911e603 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] VM Started (Lifecycle Event)
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-5db03d7d-9678-4731-9612-3252dd527694 req-77927782-acd9-4608-af30-b304fb7f1220 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5db03d7d-9678-4731-9612-3252dd527694 req-77927782-acd9-4608-af30-b304fb7f1220 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5db03d7d-9678-4731-9612-3252dd527694 req-77927782-acd9-4608-af30-b304fb7f1220 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5db03d7d-9678-4731-9612-3252dd527694 req-77927782-acd9-4608-af30-b304fb7f1220 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-5db03d7d-9678-4731-9612-3252dd527694 req-77927782-acd9-4608-af30-b304fb7f1220 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:01 user nova-compute[72405]: WARNING nova.compute.manager [req-5db03d7d-9678-4731-9612-3252dd527694 req-77927782-acd9-4608-af30-b304fb7f1220 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state resize_finish.
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538001.9171677, 855c4ef2-9d79-4495-8dd4-21b8ae09e04f => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] VM Resumed (Lifecycle Event)
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance running successfully.
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Failed to set time: agent not configured {{(pid=72405) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3794f195-2486-4d4a-86fc-7ef213a49988 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] finish_migration finished successfully. {{(pid=72405) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 08 23:40:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538001.9195476, 855c4ef2-9d79-4495-8dd4-21b8ae09e04f => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] VM Started (Lifecycle Event)
Aug 08 23:40:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:40:02 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 08 23:40:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:03 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691537988.044371, b410b764-3eab-40f1-9e27-81cefe78b0e3 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:03 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] VM Stopped (Lifecycle Event)
Aug 08 23:40:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-21066f7a-ea26-4adf-abea-57b19f3288e4 None None] [instance: b410b764-3eab-40f1-9e27-81cefe78b0e3] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:40:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:40:05 user nova-compute[72405]: INFO nova.compute.claims [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Claim successful on node user
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:40:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:40:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:40:06 user nova-compute[72405]: INFO nova.virt.block_device [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Booting with volume snapshot d0f75361-5df8-47ad-99ed-90fdc681a7f6 at /dev/vda
Aug 08 23:40:06 user nova-compute[72405]: DEBUG nova.policy [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246e22061eb47eda51b4b6634102922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc0496a99448ce8705555dc3ed9c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:40:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Successfully created port: d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Successfully updated port: d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "refresh_cache-8b9b66ab-fa68-4255-8dde-ae97ecc605b4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquired lock "refresh_cache-8b9b66ab-fa68-4255-8dde-ae97ecc605b4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-changed-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Refreshing instance network info cache due to event network-changed-d09fc878-38a6-42f7-ac16-9423d5574df8. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] Acquiring lock "refresh_cache-8b9b66ab-fa68-4255-8dde-ae97ecc605b4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:40:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Updating instance_info_cache with network_info: [{"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Releasing lock "refresh_cache-8b9b66ab-fa68-4255-8dde-ae97ecc605b4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Instance network_info: |[{"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] Acquired lock "refresh_cache-8b9b66ab-fa68-4255-8dde-ae97ecc605b4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Refreshing network info cache for port d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Updated VIF entry in instance network info cache for port d09fc878-38a6-42f7-ac16-9423d5574df8. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Updating instance_info_cache with network_info: [{"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:40:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8a489710-5509-4ad9-be8f-9aecab9765a2 req-51c9722d-b566-4df0-8075-6caab5cc0251 service nova] Releasing lock "refresh_cache-8b9b66ab-fa68-4255-8dde-ae97ecc605b4" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG os_brick.utils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80aa699-f546-4113-be6d-3907a7e693dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[828119ff-dc67-4df4-866a-eef20d843bc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f12e496-54b8-4068-90f1-3fa927c8bc35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea3e97c-4c2f-4b01-b12a-a49bc2472a84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:40:12 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:40:12 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12ffb0-19bf-41cf-b2b2-45222a265884]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG os_brick.utils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:40:12 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Updating existing volume attachment record: 0eca7e9d-177c-4850-9a44-6ddd0fc042f3 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:40:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:40:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:40:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Creating image(s)
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Ensure instance console log exists: /opt/stack/data/nova/instances/8b9b66ab-fa68-4255-8dde-ae97ecc605b4/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Start _get_guest_xml network_info=[{"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0eca7e9d-177c-4850-9a44-6ddd0fc042f3', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCdtsKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b9b66ab-fa68-4255-8dde-ae97ecc605b4', 'attached_at': '', 'detached_at': '', 'volume_id': '347a9b85-8437-495d-88f6-65a5882364de', 'serial': '347a9b85-8437-495d-88f6-65a5882364de'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:40:21 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:40:21 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCdtsKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:40:21 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:40:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:40:21 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:40:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:40:21 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[596947a7-058e-468d-aaad-ea2974bde3b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:40:21 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b7ae5-6047-4c4c-8219-e23aa94a5993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de] added
Aug 08 23:40:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[996bcba9-ea8f-4356-bc47-d1574db4287b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed96aaf-ef98-4a85-96a6-c86f3175371c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZCdtsKq {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZCdtsKq" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c5fd31-ff1c-4d13-975a-a03c73d37223]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FZCdtsKq'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c09cb53-e1b7-4a52-9695-c07f591de5c4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c09259-07e5-4d1a-8016-a303beb2d43c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d068f0-b4a7-476f-8142-a22172bf95db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260]
Aug 08 23:40:22 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260] successful.
Aug 08 23:40:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e7b76-f278-4c77-a725-ebc6678f8188]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0edf6-bdd5-40a3-8577-e327e77567d8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)
Aug 08 23:40:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:40:22 user nova-compute[72405]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)
Aug 08 23:40:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5a537-06f0-4d57-a86c-7ebacfddc10d]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:40:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCdtsKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26632326663653332', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632326663653332', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1364974720',display_name='tempest-TestVolumeBootPattern-server-1364974720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1364974720',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-3dpo2930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:40:07Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=8b9b66ab-fa68-4255-8dde-ae97ecc605b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:40:23 user nova-compute[72405]:   <uuid>8b9b66ab-fa68-4255-8dde-ae97ecc605b4</uuid>
Aug 08 23:40:23 user nova-compute[72405]:   <name>instance-00000027</name>
Aug 08 23:40:23 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:40:23 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:40:23 user nova-compute[72405]:   <metadata>
Aug 08 23:40:23 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:40:23 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:40:23 user nova-compute[72405]:       <nova:name>tempest-TestVolumeBootPattern-server-1364974720</nova:name>
Aug 08 23:40:23 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:40:21</nova:creationTime>
Aug 08 23:40:23 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:40:23 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:40:23 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:40:23 user nova-compute[72405]:       <nova:owner>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:user uuid="a246e22061eb47eda51b4b6634102922">tempest-TestVolumeBootPattern-1873778230-project-member</nova:user>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:project uuid="bffc0496a99448ce8705555dc3ed9c45">tempest-TestVolumeBootPattern-1873778230</nova:project>
Aug 08 23:40:23 user nova-compute[72405]:       </nova:owner>
Aug 08 23:40:23 user nova-compute[72405]:       <nova:ports>
Aug 08 23:40:23 user nova-compute[72405]:         <nova:port uuid="d09fc878-38a6-42f7-ac16-9423d5574df8">
Aug 08 23:40:23 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 08 23:40:23 user nova-compute[72405]:         </nova:port>
Aug 08 23:40:23 user nova-compute[72405]:       </nova:ports>
Aug 08 23:40:23 user nova-compute[72405]:     </nova:instance>
Aug 08 23:40:23 user nova-compute[72405]:   </metadata>
Aug 08 23:40:23 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:40:23 user nova-compute[72405]:     <system>
Aug 08 23:40:23 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:40:23 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:40:23 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:40:23 user nova-compute[72405]:       <entry name="serial">8b9b66ab-fa68-4255-8dde-ae97ecc605b4</entry>
Aug 08 23:40:23 user nova-compute[72405]:       <entry name="uuid">8b9b66ab-fa68-4255-8dde-ae97ecc605b4</entry>
Aug 08 23:40:23 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:40:23 user nova-compute[72405]:     </system>
Aug 08 23:40:23 user nova-compute[72405]:   </sysinfo>
Aug 08 23:40:23 user nova-compute[72405]:   <os>
Aug 08 23:40:23 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:40:23 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:40:23 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:40:23 user nova-compute[72405]:   </os>
Aug 08 23:40:23 user nova-compute[72405]:   <features>
Aug 08 23:40:23 user nova-compute[72405]:     <acpi/>
Aug 08 23:40:23 user nova-compute[72405]:     <apic/>
Aug 08 23:40:23 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:40:23 user nova-compute[72405]:   </features>
Aug 08 23:40:23 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:40:23 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:40:23 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:40:23 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:40:23 user nova-compute[72405]:   </clock>
Aug 08 23:40:23 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:40:23 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:40:23 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:40:23 user nova-compute[72405]:   </cpu>
Aug 08 23:40:23 user nova-compute[72405]:   <devices>
Aug 08 23:40:23 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:40:23 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:40:23 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:40:23 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:40:23 user nova-compute[72405]:       <serial>347a9b85-8437-495d-88f6-65a5882364de</serial>
Aug 08 23:40:23 user nova-compute[72405]:     </disk>
Aug 08 23:40:23 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:40:23 user nova-compute[72405]:       <mac address="fa:16:3e:47:09:2c"/>
Aug 08 23:40:23 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:40:23 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:40:23 user nova-compute[72405]:       <target dev="tapd09fc878-38"/>
Aug 08 23:40:23 user nova-compute[72405]:     </interface>
Aug 08 23:40:23 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:40:23 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/8b9b66ab-fa68-4255-8dde-ae97ecc605b4/console.log" append="off"/>
Aug 08 23:40:23 user nova-compute[72405]:     </serial>
Aug 08 23:40:23 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:40:23 user nova-compute[72405]:     <video>
Aug 08 23:40:23 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:40:23 user nova-compute[72405]:     </video>
Aug 08 23:40:23 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:40:23 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:40:23 user nova-compute[72405]:     </rng>
Aug 08 23:40:23 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:40:23 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:40:23 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:40:23 user nova-compute[72405]:     </memballoon>
Aug 08 23:40:23 user nova-compute[72405]:   </devices>
Aug 08 23:40:23 user nova-compute[72405]: </domain>
Aug 08 23:40:23 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1364974720',display_name='tempest-TestVolumeBootPattern-server-1364974720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1364974720',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-3dpo2930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:40:07Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=8b9b66ab-fa68-4255-8dde-ae97ecc605b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG os_vif [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd09fc878-38, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd09fc878-38, col_values=(('external_ids', {'iface-id': 'd09fc878-38a6-42f7-ac16-9423d5574df8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:09:2c', 'vm-uuid': '8b9b66ab-fa68-4255-8dde-ae97ecc605b4'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:23 user nova-compute[72405]: INFO os_vif [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38')
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:40:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No VIF found with MAC fa:16:3e:47:09:2c, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:24 user nova-compute[72405]: INFO nova.compute.manager [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Terminating instance
Aug 08 23:40:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-5d1855ff-c779-4183-be46-527113c431f7 req-f67a6cdb-a828-42f8-be46-d0c3102bb98b service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-vif-unplugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5d1855ff-c779-4183-be46-527113c431f7 req-f67a6cdb-a828-42f8-be46-d0c3102bb98b service nova] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5d1855ff-c779-4183-be46-527113c431f7 req-f67a6cdb-a828-42f8-be46-d0c3102bb98b service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5d1855ff-c779-4183-be46-527113c431f7 req-f67a6cdb-a828-42f8-be46-d0c3102bb98b service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-5d1855ff-c779-4183-be46-527113c431f7 req-f67a6cdb-a828-42f8-be46-d0c3102bb98b service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] No waiting events found dispatching network-vif-unplugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-5d1855ff-c779-4183-be46-527113c431f7 req-f67a6cdb-a828-42f8-be46-d0c3102bb98b service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-vif-unplugged-04e44c0b-eb42-4cb1-be94-413b762b740e for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Instance destroyed successfully.
Aug 08 23:40:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lazy-loading 'resources' on Instance uuid 5bdf41b1-5d1f-4911-a626-e21da4bedb0f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-216512152',display_name='tempest-ServersNegativeTestJSON-server-216512152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-216512152',id=37,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e74c497139142c6bb15ba99d7277b8f',ramdisk_id='',reservation_id='r-fifl3zfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1093456984',owner_user_name='tempest-ServersNegativeTestJSON-1093456984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:38:42Z,user_data=None,user_id='fea9b9cda387451ea9e40630216969bb',uuid=5bdf41b1-5d1f-4911-a626-e21da4bedb0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converting VIF {"id": "04e44c0b-eb42-4cb1-be94-413b762b740e", "address": "fa:16:3e:7b:05:51", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e44c0b-eb", "ovs_interfaceid": "04e44c0b-eb42-4cb1-be94-413b762b740e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG os_vif [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e44c0b-eb, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:25 user nova-compute[72405]: INFO os_vif [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:05:51,bridge_name='br-int',has_traffic_filtering=True,id=04e44c0b-eb42-4cb1-be94-413b762b740e,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e44c0b-eb')
Aug 08 23:40:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Deleting instance files /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f_del
Aug 08 23:40:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Deletion of /opt/stack/data/nova/instances/5bdf41b1-5d1f-4911-a626-e21da4bedb0f_del complete
Aug 08 23:40:25 user nova-compute[72405]: INFO nova.compute.manager [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 08 23:40:25 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:40:25 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:40:26 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Took 0.58 seconds to deallocate network for instance.
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Acquiring lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] No waiting events found dispatching network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:26 user nova-compute[72405]: WARNING nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received unexpected event network-vif-plugged-04e44c0b-eb42-4cb1-be94-413b762b740e for instance with vm_state deleted and task_state None.
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:26 user nova-compute[72405]: WARNING nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received unexpected event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with vm_state building and task_state spawning.
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:26 user nova-compute[72405]: WARNING nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received unexpected event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with vm_state building and task_state spawning.
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-3050c009-b845-4b66-b6fa-b3bfaecfe362 req-0555c71f-c48d-44c9-8a88-925440f89ff7 service nova] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Received event network-vif-deleted-04e44c0b-eb42-4cb1-be94-413b762b740e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:40:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:26 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Deleted allocations for instance 5bdf41b1-5d1f-4911-a626-e21da4bedb0f
Aug 08 23:40:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-29b196b3-ae51-4194-8c46-b272f967dee3 tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "5bdf41b1-5d1f-4911-a626-e21da4bedb0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.822s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538027.5520566, 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] VM Resumed (Lifecycle Event)
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Instance spawned successfully.
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538027.5550919, 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] VM Started (Lifecycle Event)
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 08 23:40:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:27 user nova-compute[72405]: INFO nova.compute.manager [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Took 21.93 seconds to build instance.
Aug 08 23:40:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fe661047-68bb-45da-87f3-e655ebe65c35 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.050s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:38 user nova-compute[72405]: INFO nova.compute.manager [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Terminating instance
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-d06c4a1c-6aa3-4b55-94f2-c9150d923bca req-18bb84d2-3494-4c45-acfc-14d45a9c73e3 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-vif-unplugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d06c4a1c-6aa3-4b55-94f2-c9150d923bca req-18bb84d2-3494-4c45-acfc-14d45a9c73e3 service nova] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d06c4a1c-6aa3-4b55-94f2-c9150d923bca req-18bb84d2-3494-4c45-acfc-14d45a9c73e3 service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d06c4a1c-6aa3-4b55-94f2-c9150d923bca req-18bb84d2-3494-4c45-acfc-14d45a9c73e3 service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-d06c4a1c-6aa3-4b55-94f2-c9150d923bca req-18bb84d2-3494-4c45-acfc-14d45a9c73e3 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] No waiting events found dispatching network-vif-unplugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-d06c4a1c-6aa3-4b55-94f2-c9150d923bca req-18bb84d2-3494-4c45-acfc-14d45a9c73e3 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-vif-unplugged-e7ecea70-ce83-4968-a3da-67c4362eda51 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Instance destroyed successfully.
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'resources' on Instance uuid baea144d-e0b9-484e-8898-1c2129ebb66e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1132311519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1132311519',id=25,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-m0wahmxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:33:11Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=baea144d-e0b9-484e-8898-1c2129ebb66e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "e7ecea70-ce83-4968-a3da-67c4362eda51", "address": "fa:16:3e:f0:ec:1b", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ecea70-ce", "ovs_interfaceid": "e7ecea70-ce83-4968-a3da-67c4362eda51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG os_vif [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7ecea70-ce, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:40:38 user nova-compute[72405]: INFO os_vif [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ec:1b,bridge_name='br-int',has_traffic_filtering=True,id=e7ecea70-ce83-4968-a3da-67c4362eda51,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ecea70-ce')
Aug 08 23:40:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Deleting instance files /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e_del
Aug 08 23:40:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Deletion of /opt/stack/data/nova/instances/baea144d-e0b9-484e-8898-1c2129ebb66e_del complete
Aug 08 23:40:39 user nova-compute[72405]: INFO nova.compute.manager [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 08 23:40:39 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-73e596e1-8594-4be5-a3cb-134e876d3013 req-1ec5ee64-282f-4692-b083-93744fcbaf14 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-vif-deleted-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:39 user nova-compute[72405]: INFO nova.compute.manager [req-73e596e1-8594-4be5-a3cb-134e876d3013 req-1ec5ee64-282f-4692-b083-93744fcbaf14 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Neutron deleted interface e7ecea70-ce83-4968-a3da-67c4362eda51; detaching it from the instance and deleting it from the info cache
Aug 08 23:40:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-73e596e1-8594-4be5-a3cb-134e876d3013 req-1ec5ee64-282f-4692-b083-93744fcbaf14 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:40:39 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Took 0.60 seconds to deallocate network for instance.
Aug 08 23:40:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-73e596e1-8594-4be5-a3cb-134e876d3013 req-1ec5ee64-282f-4692-b083-93744fcbaf14 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Detach interface failed, port_id=e7ecea70-ce83-4968-a3da-67c4362eda51, reason: Instance baea144d-e0b9-484e-8898-1c2129ebb66e could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:40 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Deleted allocations for instance baea144d-e0b9-484e-8898-1c2129ebb66e
Aug 08 23:40:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e4b997f4-27dc-490b-9765-9655dbc0cdf6 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538025.6219738, 5bdf41b1-5d1f-4911-a626-e21da4bedb0f => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:40 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] VM Stopped (Lifecycle Event)
Aug 08 23:40:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-69249039-ee13-4f50-960a-628c9ce337f9 None None] [instance: 5bdf41b1-5d1f-4911-a626-e21da4bedb0f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-0511fc3f-ed07-4c02-b00e-d46e0191c888 req-fe96900f-e824-482b-8996-7fe25bef3938 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received event network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0511fc3f-ed07-4c02-b00e-d46e0191c888 req-fe96900f-e824-482b-8996-7fe25bef3938 service nova] Acquiring lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0511fc3f-ed07-4c02-b00e-d46e0191c888 req-fe96900f-e824-482b-8996-7fe25bef3938 service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0511fc3f-ed07-4c02-b00e-d46e0191c888 req-fe96900f-e824-482b-8996-7fe25bef3938 service nova] Lock "baea144d-e0b9-484e-8898-1c2129ebb66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-0511fc3f-ed07-4c02-b00e-d46e0191c888 req-fe96900f-e824-482b-8996-7fe25bef3938 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] No waiting events found dispatching network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:40:40 user nova-compute[72405]: WARNING nova.compute.manager [req-0511fc3f-ed07-4c02-b00e-d46e0191c888 req-fe96900f-e824-482b-8996-7fe25bef3938 service nova] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Received unexpected event network-vif-plugged-e7ecea70-ce83-4968-a3da-67c4362eda51 for instance with vm_state deleted and task_state None.
Aug 08 23:40:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:40:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:40:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:40:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:40:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:40:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:40:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [{"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:40:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-0842ac6f-7cac-475c-8a15-d580922ce739" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:40:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:40:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:40:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:40:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:40:46 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7365MB free_disk=25.175762176513672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Applying migration context for instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f as it has an incoming, in-progress migration 95c0544a-6715-47b1-8fc5-63082daa06c6. Migration status is finished {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 08 23:40:46 user nova-compute[72405]: INFO nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating resource usage from migration 95c0544a-6715-47b1-8fc5-63082daa06c6
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance eec0a761-1764-4d0a-be00-484278dfc865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Migration 95c0544a-6715-47b1-8fc5-63082daa06c6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:40:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:40:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:40:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:40:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:53 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538038.947825, baea144d-e0b9-484e-8898-1c2129ebb66e => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:40:53 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] VM Stopped (Lifecycle Event)
Aug 08 23:40:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-89fa9630-5007-4bf3-b242-1f90be4071e5 None None] [instance: baea144d-e0b9-484e-8898-1c2129ebb66e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:40:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:40:59 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:40:59 user nova-compute[72405]: INFO nova.compute.claims [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Claim successful on node user
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:41:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.policy [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13ba98961cad44b0a1246d7d7aaf1e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2fb572f9cd475e91d08e349f2b1320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:41:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Creating image(s)
Aug 08 23:41:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "ae8d6b90abb12a753c7e5dacb8a2f22064421660" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "ae8d6b90abb12a753c7e5dacb8a2f22064421660" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.part --force-share --output=json" returned: 0 in 0.173s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG nova.virt.images [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] 0bc649c0-039a-4752-8e1f-64bc5c95c3ba was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.part /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Successfully created port: bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.part /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.converted" returned: 0 in 0.322s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "ae8d6b90abb12a753c7e5dacb8a2f22064421660" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.246s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json" returned: 0 in 0.188s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "ae8d6b90abb12a753c7e5dacb8a2f22064421660" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "ae8d6b90abb12a753c7e5dacb8a2f22064421660" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660,backing_fmt=raw /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660,backing_fmt=raw /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk 1073741824" returned: 0 in 0.055s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "ae8d6b90abb12a753c7e5dacb8a2f22064421660" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Cannot resize image /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'migration_context' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Ensure instance console log exists: /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Successfully updated port: bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing instance network info cache due to event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:41:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance network_info: |[{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.neutron [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Start _get_guest_xml network_info=[{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:40:57Z,direct_url=<?>,disk_format='qcow2',id=0bc649c0-039a-4752-8e1f-64bc5c95c3ba,min_disk=0,min_ram=0,name='tempest-scenario-img--1306076666',owner='dd2fb572f9cd475e91d08e349f2b1320',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:40:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '0bc649c0-039a-4752-8e1f-64bc5c95c3ba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:41:03 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:41:03 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:40:57Z,direct_url=<?>,disk_format='qcow2',id=0bc649c0-039a-4752-8e1f-64bc5c95c3ba,min_disk=0,min_ram=0,name='tempest-scenario-img--1306076666',owner='dd2fb572f9cd475e91d08e349f2b1320',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:40:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432474525',display_name='tempest-TestMinimumBasicScenario-server-1432474525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432474525',id=40,image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgt4050aHARdirQc1Zr73iuQ5SYeoOvZ6Vv7qfr5DKJZItgqJnGwVptVA4SqAnIB5mbi0MOa0U2cnTNpoKRmXzfLvUu/tPy1iSb20aWhUUlCS/nxbnnn1fYj5aZZ73xQ==',key_name='tempest-TestMinimumBasicScenario-1617196526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-tbgg99tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:41:00Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=2e065384-ed86-48da-a709-3d657b017a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:41:03 user nova-compute[72405]:   <uuid>2e065384-ed86-48da-a709-3d657b017a79</uuid>
Aug 08 23:41:03 user nova-compute[72405]:   <name>instance-00000028</name>
Aug 08 23:41:03 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:41:03 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:41:03 user nova-compute[72405]:   <metadata>
Aug 08 23:41:03 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:41:03 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:41:03 user nova-compute[72405]:       <nova:name>tempest-TestMinimumBasicScenario-server-1432474525</nova:name>
Aug 08 23:41:03 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:41:03</nova:creationTime>
Aug 08 23:41:03 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:41:03 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:41:03 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:41:03 user nova-compute[72405]:       <nova:owner>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:user uuid="13ba98961cad44b0a1246d7d7aaf1e9a">tempest-TestMinimumBasicScenario-511149043-project-member</nova:user>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:project uuid="dd2fb572f9cd475e91d08e349f2b1320">tempest-TestMinimumBasicScenario-511149043</nova:project>
Aug 08 23:41:03 user nova-compute[72405]:       </nova:owner>
Aug 08 23:41:03 user nova-compute[72405]:       <nova:root type="image" uuid="0bc649c0-039a-4752-8e1f-64bc5c95c3ba"/>
Aug 08 23:41:03 user nova-compute[72405]:       <nova:ports>
Aug 08 23:41:03 user nova-compute[72405]:         <nova:port uuid="bfc247d1-871f-46d3-9407-1f1ddfe4b5e9">
Aug 08 23:41:03 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 08 23:41:03 user nova-compute[72405]:         </nova:port>
Aug 08 23:41:03 user nova-compute[72405]:       </nova:ports>
Aug 08 23:41:03 user nova-compute[72405]:     </nova:instance>
Aug 08 23:41:03 user nova-compute[72405]:   </metadata>
Aug 08 23:41:03 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:41:03 user nova-compute[72405]:     <system>
Aug 08 23:41:03 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:41:03 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:41:03 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:41:03 user nova-compute[72405]:       <entry name="serial">2e065384-ed86-48da-a709-3d657b017a79</entry>
Aug 08 23:41:03 user nova-compute[72405]:       <entry name="uuid">2e065384-ed86-48da-a709-3d657b017a79</entry>
Aug 08 23:41:03 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:41:03 user nova-compute[72405]:     </system>
Aug 08 23:41:03 user nova-compute[72405]:   </sysinfo>
Aug 08 23:41:03 user nova-compute[72405]:   <os>
Aug 08 23:41:03 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:41:03 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:41:03 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:41:03 user nova-compute[72405]:   </os>
Aug 08 23:41:03 user nova-compute[72405]:   <features>
Aug 08 23:41:03 user nova-compute[72405]:     <acpi/>
Aug 08 23:41:03 user nova-compute[72405]:     <apic/>
Aug 08 23:41:03 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:41:03 user nova-compute[72405]:   </features>
Aug 08 23:41:03 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:41:03 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:41:03 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:41:03 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:41:03 user nova-compute[72405]:   </clock>
Aug 08 23:41:03 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:41:03 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:41:03 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:41:03 user nova-compute[72405]:   </cpu>
Aug 08 23:41:03 user nova-compute[72405]:   <devices>
Aug 08 23:41:03 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:41:03 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:41:03 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk"/>
Aug 08 23:41:03 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:41:03 user nova-compute[72405]:     </disk>
Aug 08 23:41:03 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:41:03 user nova-compute[72405]:       <mac address="fa:16:3e:3e:2c:45"/>
Aug 08 23:41:03 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:41:03 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:41:03 user nova-compute[72405]:       <target dev="tapbfc247d1-87"/>
Aug 08 23:41:03 user nova-compute[72405]:     </interface>
Aug 08 23:41:03 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:41:03 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/console.log" append="off"/>
Aug 08 23:41:03 user nova-compute[72405]:     </serial>
Aug 08 23:41:03 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:41:03 user nova-compute[72405]:     <video>
Aug 08 23:41:03 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:41:03 user nova-compute[72405]:     </video>
Aug 08 23:41:03 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:41:03 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:41:03 user nova-compute[72405]:     </rng>
Aug 08 23:41:03 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:41:03 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:41:03 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:41:03 user nova-compute[72405]:     </memballoon>
Aug 08 23:41:03 user nova-compute[72405]:   </devices>
Aug 08 23:41:03 user nova-compute[72405]: </domain>
Aug 08 23:41:03 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432474525',display_name='tempest-TestMinimumBasicScenario-server-1432474525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432474525',id=40,image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgt4050aHARdirQc1Zr73iuQ5SYeoOvZ6Vv7qfr5DKJZItgqJnGwVptVA4SqAnIB5mbi0MOa0U2cnTNpoKRmXzfLvUu/tPy1iSb20aWhUUlCS/nxbnnn1fYj5aZZ73xQ==',key_name='tempest-TestMinimumBasicScenario-1617196526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-tbgg99tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:41:00Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=2e065384-ed86-48da-a709-3d657b017a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG os_vif [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfc247d1-87, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfc247d1-87, col_values=(('external_ids', {'iface-id': 'bfc247d1-871f-46d3-9407-1f1ddfe4b5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:2c:45', 'vm-uuid': '2e065384-ed86-48da-a709-3d657b017a79'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:03 user nova-compute[72405]: INFO os_vif [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87')
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No VIF found with MAC fa:16:3e:3e:2c:45, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.neutron [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updated VIF entry in instance network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG nova.network.neutron [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-eae95276-7bac-42c6-929e-a9183a5d2c67 req-b109b8ca-1c2d-4556-8b44-48e5356ed5a5 service nova] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-266e6b5f-4a9d-4d62-9ccd-d59021776a14 req-6546bd9b-7de1-4cfc-bdbf-821b990260c3 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-266e6b5f-4a9d-4d62-9ccd-d59021776a14 req-6546bd9b-7de1-4cfc-bdbf-821b990260c3 service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-266e6b5f-4a9d-4d62-9ccd-d59021776a14 req-6546bd9b-7de1-4cfc-bdbf-821b990260c3 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-266e6b5f-4a9d-4d62-9ccd-d59021776a14 req-6546bd9b-7de1-4cfc-bdbf-821b990260c3 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-266e6b5f-4a9d-4d62-9ccd-d59021776a14 req-6546bd9b-7de1-4cfc-bdbf-821b990260c3 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:04 user nova-compute[72405]: WARNING nova.compute.manager [req-266e6b5f-4a9d-4d62-9ccd-d59021776a14 req-6546bd9b-7de1-4cfc-bdbf-821b990260c3 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state building and task_state spawning.
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "eec0a761-1764-4d0a-be00-484278dfc865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:05 user nova-compute[72405]: INFO nova.compute.manager [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Terminating instance
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-857696be-df92-4fe8-83db-763cef2fb88e req-38415358-a811-48d4-97b0-2bd69b42bb41 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-vif-unplugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-857696be-df92-4fe8-83db-763cef2fb88e req-38415358-a811-48d4-97b0-2bd69b42bb41 service nova] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-857696be-df92-4fe8-83db-763cef2fb88e req-38415358-a811-48d4-97b0-2bd69b42bb41 service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-857696be-df92-4fe8-83db-763cef2fb88e req-38415358-a811-48d4-97b0-2bd69b42bb41 service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-857696be-df92-4fe8-83db-763cef2fb88e req-38415358-a811-48d4-97b0-2bd69b42bb41 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] No waiting events found dispatching network-vif-unplugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-857696be-df92-4fe8-83db-763cef2fb88e req-38415358-a811-48d4-97b0-2bd69b42bb41 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-vif-unplugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:41:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Instance destroyed successfully.
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lazy-loading 'resources' on Instance uuid eec0a761-1764-4d0a-be00-484278dfc865 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1705977104',display_name='tempest-VolumesActionsTest-instance-1705977104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1705977104',id=38,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2429c9eebe014d6f9bc61ff7b6cc68d4',ramdisk_id='',reservation_id='r-e8lr27qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-261489940',owner_user_name='tempest-VolumesActionsTest-261489940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:39:22Z,user_data=None,user_id='95d69553a04149d1a0a53ac53194db88',uuid=eec0a761-1764-4d0a-be00-484278dfc865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converting VIF {"id": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "address": "fa:16:3e:c4:51:5b", "network": {"id": "2fc1ad5c-56a7-4b64-8397-00c868fc9559", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1985435569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2429c9eebe014d6f9bc61ff7b6cc68d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a8b63b-d4", "ovs_interfaceid": "40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG os_vif [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40a8b63b-d4, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:05 user nova-compute[72405]: INFO os_vif [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:51:5b,bridge_name='br-int',has_traffic_filtering=True,id=40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c,network=Network(2fc1ad5c-56a7-4b64-8397-00c868fc9559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a8b63b-d4')
Aug 08 23:41:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Deleting instance files /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865_del
Aug 08 23:41:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Deletion of /opt/stack/data/nova/instances/eec0a761-1764-4d0a-be00-484278dfc865_del complete
Aug 08 23:41:05 user nova-compute[72405]: INFO nova.compute.manager [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 08 23:41:05 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:41:05 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:06 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Took 0.55 seconds to deallocate network for instance.
Aug 08 23:41:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538066.9130883, 2e065384-ed86-48da-a709-3d657b017a79 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:41:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] VM Resumed (Lifecycle Event)
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:06 user nova-compute[72405]: WARNING nova.compute.manager [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state building and task_state spawning.
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-3594e24a-08f2-4d39-bc99-9a7810345c50 req-9f2e7ffe-8172-4624-a14a-e4cdab6da6a7 service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-vif-deleted-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance spawned successfully.
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:41:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:41:06 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538066.9138405, 2e065384-ed86-48da-a709-3d657b017a79 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:41:06 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] VM Started (Lifecycle Event)
Aug 08 23:41:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:41:07 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:41:07 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Deleted allocations for instance eec0a761-1764-4d0a-be00-484278dfc865
Aug 08 23:41:07 user nova-compute[72405]: INFO nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 08 23:41:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-11daba79-2f47-481b-ada0-d929e3cf6000 tempest-VolumesActionsTest-261489940 tempest-VolumesActionsTest-261489940-project-member] Lock "eec0a761-1764-4d0a-be00-484278dfc865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.921s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:07 user nova-compute[72405]: INFO nova.compute.manager [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Took 7.33 seconds to build instance.
Aug 08 23:41:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d015f78c-f37d-4877-81ac-06f8c5b6ab34 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.440s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-2f50afc5-e5a1-4d34-afee-d2d3c093c785 req-e0f9cf07-4c47-48b4-af35-649c47b9bd8c service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received event network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2f50afc5-e5a1-4d34-afee-d2d3c093c785 req-e0f9cf07-4c47-48b4-af35-649c47b9bd8c service nova] Acquiring lock "eec0a761-1764-4d0a-be00-484278dfc865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2f50afc5-e5a1-4d34-afee-d2d3c093c785 req-e0f9cf07-4c47-48b4-af35-649c47b9bd8c service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2f50afc5-e5a1-4d34-afee-d2d3c093c785 req-e0f9cf07-4c47-48b4-af35-649c47b9bd8c service nova] Lock "eec0a761-1764-4d0a-be00-484278dfc865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-2f50afc5-e5a1-4d34-afee-d2d3c093c785 req-e0f9cf07-4c47-48b4-af35-649c47b9bd8c service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] No waiting events found dispatching network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:07 user nova-compute[72405]: WARNING nova.compute.manager [req-2f50afc5-e5a1-4d34-afee-d2d3c093c785 req-e0f9cf07-4c47-48b4-af35-649c47b9bd8c service nova] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Received unexpected event network-vif-plugged-40a8b63b-d4a3-4cb1-b1b1-ae5a707d277c for instance with vm_state deleted and task_state None.
Aug 08 23:41:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Going to confirm migration 2 {{(pid=72405) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'info_cache' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'migration_context' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:16 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:41:16 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:41:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.394s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:16 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Deleted allocation for migration 95c0544a-6715-47b1-8fc5-63082daa06c6
Aug 08 23:41:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d697ef11-3600-48e6-9cdf-bedb2b17f962 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.502s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:20 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538065.819271, eec0a761-1764-4d0a-be00-484278dfc865 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:41:20 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: eec0a761-1764-4d0a-be00-484278dfc865] VM Stopped (Lifecycle Event)
Aug 08 23:41:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc189bb9-f1c9-464c-893e-c16ebeca9d25 None None] [instance: eec0a761-1764-4d0a-be00-484278dfc865] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:41:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:28 user nova-compute[72405]: INFO nova.compute.manager [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Terminating instance
Aug 08 23:41:28 user nova-compute[72405]: DEBUG nova.compute.manager [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:41:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-b87adcb1-88d3-4288-9274-a3beb9435ca8 req-a3d10340-3b28-4af9-9b65-1407487209f1 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b87adcb1-88d3-4288-9274-a3beb9435ca8 req-a3d10340-3b28-4af9-9b65-1407487209f1 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b87adcb1-88d3-4288-9274-a3beb9435ca8 req-a3d10340-3b28-4af9-9b65-1407487209f1 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b87adcb1-88d3-4288-9274-a3beb9435ca8 req-a3d10340-3b28-4af9-9b65-1407487209f1 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-b87adcb1-88d3-4288-9274-a3beb9435ca8 req-a3d10340-3b28-4af9-9b65-1407487209f1 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-b87adcb1-88d3-4288-9274-a3beb9435ca8 req-a3d10340-3b28-4af9-9b65-1407487209f1 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Instance destroyed successfully.
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'resources' on Instance uuid 2adde477-61ea-4f06-a71d-86a3d94902f2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743707640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743707640',id=14,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:27:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-qbho4jw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:29:28Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=2adde477-61ea-4f06-a71d-86a3d94902f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "b92a56a7-a14c-479f-852d-f8308c418daf", "address": "fa:16:3e:52:c2:72", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92a56a7-a1", "ovs_interfaceid": "b92a56a7-a14c-479f-852d-f8308c418daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_vif [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb92a56a7-a1, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:41:29 user nova-compute[72405]: INFO os_vif [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:c2:72,bridge_name='br-int',has_traffic_filtering=True,id=b92a56a7-a14c-479f-852d-f8308c418daf,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92a56a7-a1')
Aug 08 23:41:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAxJkVXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:41:29 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df6ae23-925b-44a7-8ba9-d2bc0f796a5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[121ac996-7335-4cd4-96b7-f0bd517425aa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:41:29 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:41:29 user nova-compute[72405]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)
Aug 08 23:41:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 (non-flash)
Aug 08 23:41:29 user nova-compute[72405]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:41:29 user nova-compute[72405]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)
Aug 08 23:41:29 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f8aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bbc91f-4da0-4aaf-b823-56e41cb0a2e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad71e41-7f8c-4686-a1df-056be6585a01]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[987265aa-754d-49d2-a2f4-f38be28933d6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[35692489-e966-4bf9-9ee8-5b4afca27e1a]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb0419-0e27-45d8-bfef-e0d26ba601a8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.173s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee38e1b7-40a4-42ac-b500-35731a3ee01c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260]
Aug 08 23:41:30 user nova-compute[72405]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2, portal: 172.16.0.220,3260] successful.
Aug 08 23:41:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22783579-94d2-4c13-b34a-b324335d69d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f0ae73-5754-4e61-be47-24ddaecd6e2b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] <== disconnect_volume: return (423ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:41:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Deleting instance files /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2_del
Aug 08 23:41:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Deletion of /opt/stack/data/nova/instances/2adde477-61ea-4f06-a71d-86a3d94902f2_del complete
Aug 08 23:41:30 user nova-compute[72405]: INFO nova.compute.manager [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 08 23:41:30 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:30 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Took 0.49 seconds to deallocate network for instance.
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-b76dcdc1-c8a0-4391-8042-d572aea2449b req-eacc9e07-a388-40ea-b958-7f2d9ad74371 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-deleted-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:30 user nova-compute[72405]: INFO nova.compute.manager [req-b76dcdc1-c8a0-4391-8042-d572aea2449b req-eacc9e07-a388-40ea-b958-7f2d9ad74371 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Neutron deleted interface b92a56a7-a14c-479f-852d-f8308c418daf; detaching it from the instance and deleting it from the info cache
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.network.neutron [req-b76dcdc1-c8a0-4391-8042-d572aea2449b req-eacc9e07-a388-40ea-b958-7f2d9ad74371 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-b76dcdc1-c8a0-4391-8042-d572aea2449b req-eacc9e07-a388-40ea-b958-7f2d9ad74371 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Detach interface failed, port_id=b92a56a7-a14c-479f-852d-f8308c418daf, reason: Instance 2adde477-61ea-4f06-a71d-86a3d94902f2 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:31 user nova-compute[72405]: WARNING nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state deleting.
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:31 user nova-compute[72405]: WARNING nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state deleting.
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:31 user nova-compute[72405]: WARNING nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state deleting.
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-unplugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Acquiring lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] No waiting events found dispatching network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:31 user nova-compute[72405]: WARNING nova.compute.manager [req-5fe9784d-6d25-4bd8-8887-1cea0b4f0a82 req-bdb84a36-276e-4ceb-90c1-ef6080f594d0 service nova] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Received unexpected event network-vif-plugged-b92a56a7-a14c-479f-852d-f8308c418daf for instance with vm_state active and task_state deleting.
Aug 08 23:41:31 user nova-compute[72405]: INFO nova.compute.manager [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Took 0.73 seconds to detach 1 volumes for instance.
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:31 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Deleted allocations for instance 2adde477-61ea-4f06-a71d-86a3d94902f2
Aug 08 23:41:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-260a42b3-e72c-4e21-8a82-d703a603e095 tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "2adde477-61ea-4f06-a71d-86a3d94902f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:38 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:41:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:41:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:41:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:41:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [{"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e5fc6348-e237-4f86-8179-c5dc34b9e1d2" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:41:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:41:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:44 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538089.6494997, 2adde477-61ea-4f06-a71d-86a3d94902f2 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:41:44 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] VM Stopped (Lifecycle Event)
Aug 08 23:41:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e34ccf89-12cc-4cb1-b9db-27e4e6738f3d None None] [instance: 2adde477-61ea-4f06-a71d-86a3d94902f2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:41:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:41:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:48 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:41:48 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7557MB free_disk=25.10348892211914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0842ac6f-7cac-475c-8a15-d580922ce739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2e065384-ed86-48da-a709-3d657b017a79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:41:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:41:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:41:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:41:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:41:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:41:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:41:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:41:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:41:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:41:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:56 user nova-compute[72405]: INFO nova.compute.manager [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Terminating instance
Aug 08 23:41:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-266e2986-6850-488e-b2c9-833c2bca59e9 req-59598595-880b-44de-a509-235ff817f07a service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-unplugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-266e2986-6850-488e-b2c9-833c2bca59e9 req-59598595-880b-44de-a509-235ff817f07a service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-266e2986-6850-488e-b2c9-833c2bca59e9 req-59598595-880b-44de-a509-235ff817f07a service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-266e2986-6850-488e-b2c9-833c2bca59e9 req-59598595-880b-44de-a509-235ff817f07a service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-266e2986-6850-488e-b2c9-833c2bca59e9 req-59598595-880b-44de-a509-235ff817f07a service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-unplugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-266e2986-6850-488e-b2c9-833c2bca59e9 req-59598595-880b-44de-a509-235ff817f07a service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-unplugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Instance destroyed successfully.
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'resources' on Instance uuid 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1364974720',display_name='tempest-TestVolumeBootPattern-server-1364974720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1364974720',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-3dpo2930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:40:28Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=8b9b66ab-fa68-4255-8dde-ae97ecc605b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "d09fc878-38a6-42f7-ac16-9423d5574df8", "address": "fa:16:3e:47:09:2c", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd09fc878-38", "ovs_interfaceid": "d09fc878-38a6-42f7-ac16-9423d5574df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_vif [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd09fc878-38, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:41:57 user nova-compute[72405]: INFO os_vif [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:09:2c,bridge_name='br-int',has_traffic_filtering=True,id=d09fc878-38a6-42f7-ac16-9423d5574df8,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd09fc878-38')
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCdtsKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:41:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[578da85c-7654-4dc8-948d-b1ee1e6ccb25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa47ed13-7780-48f9-a1ce-a180d6dd0b6b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:41:57 user nova-compute[72405]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)
Aug 08 23:41:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:41:57 user nova-compute[72405]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de (non-flash)
Aug 08 23:41:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7c17f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e50401-7cae-4279-90a4-60341c379e7b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbf0acd-b134-4a61-b4e4-23c58197308b]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1317b-ca62-44c2-aa07-87cafee687d1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71be512c-1e4b-4a75-adf9-e11517204da6]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26632326663653332', '/dev/disk/by-id/scsi-1SCST_BIObed6972c-f22fce3267c7974c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bed6972c') {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463ba87-3ef5-453f-b452-33738b4fe960]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16246e-bfd0-45f0-bc28-3f698e0e2f17]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f29f45-1819-45d4-9a5a-eb5c351b205e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260]
Aug 08 23:41:57 user nova-compute[72405]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de, portal: 172.16.0.220,3260] successful.
Aug 08 23:41:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347a9b85-8437-495d-88f6-65a5882364de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f425e9-ec26-4bc3-bdd0-84335efcddb8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== disconnect_volume: return (359ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:41:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Deleting instance files /opt/stack/data/nova/instances/8b9b66ab-fa68-4255-8dde-ae97ecc605b4_del
Aug 08 23:41:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Deletion of /opt/stack/data/nova/instances/8b9b66ab-fa68-4255-8dde-ae97ecc605b4_del complete
Aug 08 23:41:57 user nova-compute[72405]: INFO nova.compute.manager [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 08 23:41:57 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:41:58 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Took 0.80 seconds to deallocate network for instance.
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:58 user nova-compute[72405]: WARNING nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received unexpected event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with vm_state active and task_state deleting.
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:58 user nova-compute[72405]: WARNING nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received unexpected event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with vm_state active and task_state deleting.
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:58 user nova-compute[72405]: WARNING nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received unexpected event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with vm_state active and task_state deleting.
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-unplugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-unplugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-unplugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Acquiring lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] No waiting events found dispatching network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:41:58 user nova-compute[72405]: WARNING nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received unexpected event network-vif-plugged-d09fc878-38a6-42f7-ac16-9423d5574df8 for instance with vm_state active and task_state deleting.
Aug 08 23:41:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-41bcf3da-4d40-40dd-8d3c-3f0c4e5197f7 req-d4a94302-d49c-4c1c-9ce1-cf0a705b2053 service nova] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Received event network-vif-deleted-d09fc878-38a6-42f7-ac16-9423d5574df8 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:41:59 user nova-compute[72405]: INFO nova.compute.manager [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Took 0.72 seconds to detach 1 volumes for instance.
Aug 08 23:41:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Deleting volume: 347a9b85-8437-495d-88f6-65a5882364de {{(pid=72405) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 08 23:41:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:41:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:41:59 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:41:59 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:41:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:41:59 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Deleted allocations for instance 8b9b66ab-fa68-4255-8dde-ae97ecc605b4
Aug 08 23:41:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-369783ae-793e-4349-9680-96735adc3b65 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "8b9b66ab-fa68-4255-8dde-ae97ecc605b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.337s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:42:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:42:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:42:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:42:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:42:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:12 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538117.3433282, 8b9b66ab-fa68-4255-8dde-ae97ecc605b4 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:42:12 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] VM Stopped (Lifecycle Event)
Aug 08 23:42:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e0559a8b-3b2a-46e4-9c05-f0dc79c3fa4f None None] [instance: 8b9b66ab-fa68-4255-8dde-ae97ecc605b4] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:42:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:42:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:19 user nova-compute[72405]: INFO nova.compute.manager [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Terminating instance
Aug 08 23:42:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-4a2f55c8-4b4a-4054-a424-5c8ec751334e req-e5efc728-b637-43ed-ad8a-e750d0ac73fc service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-vif-unplugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4a2f55c8-4b4a-4054-a424-5c8ec751334e req-e5efc728-b637-43ed-ad8a-e750d0ac73fc service nova] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4a2f55c8-4b4a-4054-a424-5c8ec751334e req-e5efc728-b637-43ed-ad8a-e750d0ac73fc service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4a2f55c8-4b4a-4054-a424-5c8ec751334e req-e5efc728-b637-43ed-ad8a-e750d0ac73fc service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-4a2f55c8-4b4a-4054-a424-5c8ec751334e req-e5efc728-b637-43ed-ad8a-e750d0ac73fc service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] No waiting events found dispatching network-vif-unplugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-4a2f55c8-4b4a-4054-a424-5c8ec751334e req-e5efc728-b637-43ed-ad8a-e750d0ac73fc service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-vif-unplugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Instance destroyed successfully.
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lazy-loading 'resources' on Instance uuid 0842ac6f-7cac-475c-8a15-d580922ce739 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1671331769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1671331769',id=2,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf26de781ef4462914d7f32168b3192',ramdisk_id='',reservation_id='r-00ofaqet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:24:37Z,user_data=None,user_id='d9b5279220af4cc4a364014419168ae8',uuid=0842ac6f-7cac-475c-8a15-d580922ce739,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converting VIF {"id": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "address": "fa:16:3e:a5:2c:90", "network": {"id": "55faef13-b2ce-4ae9-a064-e2ceebc9f599", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213354399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf26de781ef4462914d7f32168b3192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e92c8b8-06", "ovs_interfaceid": "9e92c8b8-06aa-4479-9b39-3e9e17109492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG os_vif [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e92c8b8-06, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:42:20 user nova-compute[72405]: INFO os_vif [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2c:90,bridge_name='br-int',has_traffic_filtering=True,id=9e92c8b8-06aa-4479-9b39-3e9e17109492,network=Network(55faef13-b2ce-4ae9-a064-e2ceebc9f599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e92c8b8-06')
Aug 08 23:42:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Deleting instance files /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739_del
Aug 08 23:42:20 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Deletion of /opt/stack/data/nova/instances/0842ac6f-7cac-475c-8a15-d580922ce739_del complete
Aug 08 23:42:20 user nova-compute[72405]: INFO nova.compute.manager [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 08 23:42:20 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:42:20 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:42:21 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:42:21 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Took 0.98 seconds to deallocate network for instance.
Aug 08 23:42:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-5a695584-f9ec-4e62-848a-65eaae2813f0 req-6622f156-5c2e-4153-9df9-f144adb06fe2 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-vif-deleted-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:21 user nova-compute[72405]: INFO nova.compute.manager [req-5a695584-f9ec-4e62-848a-65eaae2813f0 req-6622f156-5c2e-4153-9df9-f144adb06fe2 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Neutron deleted interface 9e92c8b8-06aa-4479-9b39-3e9e17109492; detaching it from the instance and deleting it from the info cache
Aug 08 23:42:21 user nova-compute[72405]: DEBUG nova.network.neutron [req-5a695584-f9ec-4e62-848a-65eaae2813f0 req-6622f156-5c2e-4153-9df9-f144adb06fe2 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:42:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-5a695584-f9ec-4e62-848a-65eaae2813f0 req-6622f156-5c2e-4153-9df9-f144adb06fe2 service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Detach interface failed, port_id=9e92c8b8-06aa-4479-9b39-3e9e17109492, reason: Instance 0842ac6f-7cac-475c-8a15-d580922ce739 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:42:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:21 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:42:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:42:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-912c6ffb-e0b5-40e8-9a82-b26e1988efb3 req-1a96de96-2506-422b-af1c-825f0150b3eb service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received event network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-912c6ffb-e0b5-40e8-9a82-b26e1988efb3 req-1a96de96-2506-422b-af1c-825f0150b3eb service nova] Acquiring lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-912c6ffb-e0b5-40e8-9a82-b26e1988efb3 req-1a96de96-2506-422b-af1c-825f0150b3eb service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-912c6ffb-e0b5-40e8-9a82-b26e1988efb3 req-1a96de96-2506-422b-af1c-825f0150b3eb service nova] Lock "0842ac6f-7cac-475c-8a15-d580922ce739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-912c6ffb-e0b5-40e8-9a82-b26e1988efb3 req-1a96de96-2506-422b-af1c-825f0150b3eb service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] No waiting events found dispatching network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:42:22 user nova-compute[72405]: WARNING nova.compute.manager [req-912c6ffb-e0b5-40e8-9a82-b26e1988efb3 req-1a96de96-2506-422b-af1c-825f0150b3eb service nova] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Received unexpected event network-vif-plugged-9e92c8b8-06aa-4479-9b39-3e9e17109492 for instance with vm_state deleted and task_state None.
Aug 08 23:42:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.897s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:23 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Deleted allocations for instance 0842ac6f-7cac-475c-8a15-d580922ce739
Aug 08 23:42:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-38c56f3c-3c8e-45bf-8064-d5eed28657ba tempest-ServerBootFromVolumeStableRescueTest-1549652719 tempest-ServerBootFromVolumeStableRescueTest-1549652719-project-member] Lock "0842ac6f-7cac-475c-8a15-d580922ce739" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.810s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:35 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538140.5063307, 0842ac6f-7cac-475c-8a15-d580922ce739 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:42:35 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] VM Stopped (Lifecycle Event)
Aug 08 23:42:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-4c21f202-e04d-4e2e-b9c8-92417c60954c None None] [instance: 0842ac6f-7cac-475c-8a15-d580922ce739] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:42:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:42:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:42:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:42:42 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:42:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updating instance_info_cache with network_info: [{"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:42:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:42:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:42:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:42:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:48 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:42:48 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:42:48 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7995MB free_disk=25.22614288330078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2e065384-ed86-48da-a709-3d657b017a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:42:49 user nova-compute[72405]: INFO nova.compute.manager [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Rescuing
Aug 08 23:42:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:42:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.network.neutron [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-85bbf5e6-0f21-42a2-87a8-ffc4eb99862b req-cfdffbae-2778-4093-948f-c22b940f81f3 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-85bbf5e6-0f21-42a2-87a8-ffc4eb99862b req-cfdffbae-2778-4093-948f-c22b940f81f3 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-85bbf5e6-0f21-42a2-87a8-ffc4eb99862b req-cfdffbae-2778-4093-948f-c22b940f81f3 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-85bbf5e6-0f21-42a2-87a8-ffc4eb99862b req-cfdffbae-2778-4093-948f-c22b940f81f3 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-85bbf5e6-0f21-42a2-87a8-ffc4eb99862b req-cfdffbae-2778-4093-948f-c22b940f81f3 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:42:50 user nova-compute[72405]: WARNING nova.compute.manager [req-85bbf5e6-0f21-42a2-87a8-ffc4eb99862b req-cfdffbae-2778-4093-948f-c22b940f81f3 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state active and task_state rescuing.
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance destroyed successfully.
Aug 08 23:42:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Attempting rescue
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72405) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:42:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Creating image(s)
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'trusted_certs' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue" returned: 0 in 0.053s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'migration_context' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Start _get_guest_xml network_info=[{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:63:5b:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'resources' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'numa_topology' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:42:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:42:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-140745293',display_name='tempest-ServerRescueNegativeTestJSON-server-140745293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-140745293',id=35,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:38:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5lyapbwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:38:12Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=04f2ae79-2d01-4a28-888c-93b50bc61a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:63:5b:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:63:5b:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'pci_devices' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:42:51 user nova-compute[72405]:   <uuid>04f2ae79-2d01-4a28-888c-93b50bc61a07</uuid>
Aug 08 23:42:51 user nova-compute[72405]:   <name>instance-00000023</name>
Aug 08 23:42:51 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:42:51 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:42:51 user nova-compute[72405]:   <metadata>
Aug 08 23:42:51 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:42:51 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:42:51 user nova-compute[72405]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-140745293</nova:name>
Aug 08 23:42:51 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:42:50</nova:creationTime>
Aug 08 23:42:51 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:42:51 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:42:51 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:42:51 user nova-compute[72405]:       <nova:owner>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:user uuid="94a805b078b640c29ae13aabfd1fd5a5">tempest-ServerRescueNegativeTestJSON-297666519-project-member</nova:user>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:project uuid="93111863a9dc43b9a50c61a6c1f4c52c">tempest-ServerRescueNegativeTestJSON-297666519</nova:project>
Aug 08 23:42:51 user nova-compute[72405]:       </nova:owner>
Aug 08 23:42:51 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:42:51 user nova-compute[72405]:       <nova:ports>
Aug 08 23:42:51 user nova-compute[72405]:         <nova:port uuid="b831cee5-5e09-444f-98d9-f561e21aa92e">
Aug 08 23:42:51 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 08 23:42:51 user nova-compute[72405]:         </nova:port>
Aug 08 23:42:51 user nova-compute[72405]:       </nova:ports>
Aug 08 23:42:51 user nova-compute[72405]:     </nova:instance>
Aug 08 23:42:51 user nova-compute[72405]:   </metadata>
Aug 08 23:42:51 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:42:51 user nova-compute[72405]:     <system>
Aug 08 23:42:51 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:42:51 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:42:51 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:42:51 user nova-compute[72405]:       <entry name="serial">04f2ae79-2d01-4a28-888c-93b50bc61a07</entry>
Aug 08 23:42:51 user nova-compute[72405]:       <entry name="uuid">04f2ae79-2d01-4a28-888c-93b50bc61a07</entry>
Aug 08 23:42:51 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:42:51 user nova-compute[72405]:     </system>
Aug 08 23:42:51 user nova-compute[72405]:   </sysinfo>
Aug 08 23:42:51 user nova-compute[72405]:   <os>
Aug 08 23:42:51 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:42:51 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:42:51 user nova-compute[72405]:   </os>
Aug 08 23:42:51 user nova-compute[72405]:   <features>
Aug 08 23:42:51 user nova-compute[72405]:     <acpi/>
Aug 08 23:42:51 user nova-compute[72405]:     <apic/>
Aug 08 23:42:51 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:42:51 user nova-compute[72405]:   </features>
Aug 08 23:42:51 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:42:51 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:42:51 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:42:51 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:42:51 user nova-compute[72405]:   </clock>
Aug 08 23:42:51 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:42:51 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:42:51 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:42:51 user nova-compute[72405]:   </cpu>
Aug 08 23:42:51 user nova-compute[72405]:   <devices>
Aug 08 23:42:51 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:42:51 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:42:51 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue"/>
Aug 08 23:42:51 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:42:51 user nova-compute[72405]:     </disk>
Aug 08 23:42:51 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:42:51 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:42:51 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk"/>
Aug 08 23:42:51 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:42:51 user nova-compute[72405]:     </disk>
Aug 08 23:42:51 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:42:51 user nova-compute[72405]:       <mac address="fa:16:3e:63:5b:43"/>
Aug 08 23:42:51 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:42:51 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:42:51 user nova-compute[72405]:       <target dev="tapb831cee5-5e"/>
Aug 08 23:42:51 user nova-compute[72405]:     </interface>
Aug 08 23:42:51 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:42:51 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/console.log" append="off"/>
Aug 08 23:42:51 user nova-compute[72405]:     </serial>
Aug 08 23:42:51 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:42:51 user nova-compute[72405]:     <video>
Aug 08 23:42:51 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:42:51 user nova-compute[72405]:     </video>
Aug 08 23:42:51 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:42:51 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:42:51 user nova-compute[72405]:     </rng>
Aug 08 23:42:51 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:42:51 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:42:51 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:42:51 user nova-compute[72405]:     </memballoon>
Aug 08 23:42:51 user nova-compute[72405]:   </devices>
Aug 08 23:42:51 user nova-compute[72405]: </domain>
Aug 08 23:42:51 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:42:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance destroyed successfully.
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:42:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:63:5b:43, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-6cdc1a9e-2fa8-448d-b165-08967ff2441f req-8ccf5541-57d3-4324-876a-35c7e9a277ab service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6cdc1a9e-2fa8-448d-b165-08967ff2441f req-8ccf5541-57d3-4324-876a-35c7e9a277ab service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6cdc1a9e-2fa8-448d-b165-08967ff2441f req-8ccf5541-57d3-4324-876a-35c7e9a277ab service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6cdc1a9e-2fa8-448d-b165-08967ff2441f req-8ccf5541-57d3-4324-876a-35c7e9a277ab service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG nova.compute.manager [req-6cdc1a9e-2fa8-448d-b165-08967ff2441f req-8ccf5541-57d3-4324-876a-35c7e9a277ab service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:42:52 user nova-compute[72405]: WARNING nova.compute.manager [req-6cdc1a9e-2fa8-448d-b165-08967ff2441f req-8ccf5541-57d3-4324-876a-35c7e9a277ab service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state active and task_state rescuing.
Aug 08 23:42:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'flavor' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:54 user nova-compute[72405]: INFO nova.compute.manager [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Attaching volume 55c49ca9-8576-4276-9e38-5777dcfb21c2 to /dev/vdb
Aug 08 23:42:54 user nova-compute[72405]: DEBUG os_brick.utils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c5d07f-9fa9-4c8c-8b7e-1b947e5b0d48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af3c86-9bd9-4bc9-a212-ae9e8bae5c68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d0f953-122c-4d39-a43b-154e862fc53a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ad98d-0df9-4a1f-907f-59fa4fb2a0df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:42:54 user nova-compute[72405]: WARNING nova.compute.manager [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state active and task_state rescuing.
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:42:54 user nova-compute[72405]: WARNING nova.compute.manager [req-68138931-cd00-49cc-8d51-399994b3811f req-17af63fc-f462-4630-a3b3-91ea653f3c30 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state active and task_state rescuing.
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:42:54 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:42:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cb78e-1845-4d34-a17d-18455d7f7479]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG os_brick.utils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating existing volume attachment record: a5a04659-0d5e-4c63-866d-3951c691f607 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 04f2ae79-2d01-4a28-888c-93b50bc61a07 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538174.876844, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:42:54 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Resumed (Lifecycle Event)
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-775a1055-7672-4265-ba81-56fe41d6e255 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:42:54 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538174.8785381, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:42:54 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Started (Lifecycle Event)
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:42:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:42:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:42:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:43:02 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:02 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:02 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[308b0d63-22d6-4eaa-8188-9eac1e4df29d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:43:02 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cdac52-f88e-4b03-8887-d41cd77a2a94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2] added
Aug 08 23:43:02 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605f787-80d9-48dc-93bb-3e2e4961b73a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f654f-0630-42f1-b7e4-ab50a255f95a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qoIXxkOU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qoIXxkOU" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ee55b3-62ac-41d0-868b-429bb8b83a5c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qoIXxkOU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:02 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a4c5e1-5e12-41f5-99fe-c560eeaf8732]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[829f45a9-8d17-4049-873b-b53433e50d63]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:03 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:03 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b70340-8829-4900-9905-e9b597aaad2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]
Aug 08 23:43:03 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.
Aug 08 23:43:03 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7bb408-7cd2-4878-967a-f34b4e59b6b3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a65a89-7d48-45c0-90fe-e7e859bc41ca]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:03 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:03 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:03 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:03 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba24e4e-7bea-425e-8591-428e334d73fc]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:03 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26638353464393663', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353464393663', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'flavor' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:43:04 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:43:04 user nova-compute[72405]:   <source dev="/dev/sdc"/>
Aug 08 23:43:04 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:43:04 user nova-compute[72405]:   <serial>55c49ca9-8576-4276-9e38-5777dcfb21c2</serial>
Aug 08 23:43:04 user nova-compute[72405]: </disk>
Aug 08 23:43:04 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No VIF found with MAC fa:16:3e:3e:2c:45, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:43:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c1423206-e368-4a51-8a23-0dc26218074d tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.499s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:43:06 user nova-compute[72405]: INFO nova.compute.manager [None req-1d0c14dd-2581-4653-99e7-e177eb9136f1 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Get console output
Aug 08 23:43:06 user nova-compute[72405]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 08 23:43:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:43:08 user nova-compute[72405]: INFO nova.compute.claims [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Claim successful on node user
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:43:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:43:08 user nova-compute[72405]: INFO nova.virt.block_device [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Booting with volume 104ea5aa-8da3-4871-afd2-c3f8afdb87d6 at /dev/vda
Aug 08 23:43:08 user nova-compute[72405]: DEBUG nova.policy [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246e22061eb47eda51b4b6634102922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc0496a99448ce8705555dc3ed9c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG os_brick.utils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea408a-d0a2-439d-b673-fd834b1bcc9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e777ca7-0654-479f-b4eb-7c95dfd32ec3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[50843e7d-6b81-4c39-b0ec-579edd4c2e2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa34dc29-e1e7-4203-85cf-2c296ad8cdc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:43:09 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:43:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab25a6-43c5-4363-b802-6dcd01705438]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG os_brick.utils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updating existing volume attachment record: a90dba84-8e51-4b19-b040-4c6a2d6a4488 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Successfully created port: c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Successfully updated port: c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquired lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-changed-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Refreshing instance network info cache due to event network-changed-c8837325-2bb8-4285-b48a-d5290f36d105. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:43:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] Acquiring lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updating instance_info_cache with network_info: [{"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Releasing lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Instance network_info: |[{"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] Acquired lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Refreshing network info cache for port c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updated VIF entry in instance network info cache for port c8837325-2bb8-4285-b48a-d5290f36d105. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updating instance_info_cache with network_info: [{"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dbb5dea7-8b0d-4945-b25f-02e154d4c488 req-ad197606-4c1a-4e41-88b9-092ba07d0b26 service nova] Releasing lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing instance network info cache due to event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:43:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:43:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updated VIF entry in instance network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:43:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2ae89a56-8883-45a3-b2c0-9d252d88fc50 req-5dd00669-6740-4cbb-bdba-6737891bf91a service nova] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:43:18 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Creating image(s)
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Ensure instance console log exists: /opt/stack/data/nova/instances/6c79afac-4015-4d1b-beb5-ee59d051da3c/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Start _get_guest_xml network_info=[{"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a90dba84-8e51-4b19-b040-4c6a2d6a4488', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXmBaCYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c79afac-4015-4d1b-beb5-ee59d051da3c', 'attached_at': '', 'detached_at': '', 'volume_id': '104ea5aa-8da3-4871-afd2-c3f8afdb87d6', 'serial': '104ea5aa-8da3-4871-afd2-c3f8afdb87d6'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:43:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXmBaCYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:43:18 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:18 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:18 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c0dd4b-dbfd-4762-9474-358fcf716e29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:43:18 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9728ac-4a14-49a3-a566-25617a4e4568]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6] added
Aug 08 23:43:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6ad80-8ec5-46e7-9329-d54684db3697]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7489a8-154f-4e26-b49a-b1421e35bf0d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXmBaCYS {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXmBaCYS" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a54fc-ca35-463a-8187-e999537fd9b8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXmBaCYS'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4515724e-9b84-4c90-b188-9c4c8fbddef0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87fde22-45de-417b-8d39-26885dd3a715]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[242c866e-56b6-4cf7-a628-2282971c5979]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260]
Aug 08 23:43:18 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260] successful.
Aug 08 23:43:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[80317e3e-15fb-49cf-916d-b95b8616279b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674fb51-2fbb-49c9-9548-f54c077d9ea0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:18 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce347a41-bf32-477e-9609-82e7e8150314]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXmBaCYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing instance network info cache due to event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.network.neutron [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updated VIF entry in instance network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.network.neutron [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3a4c20ce-43b6-4665-ad86-6b4e43d61558 req-8d3cd983-1cfd-44b4-80e6-1ec37fe31d2d service nova] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23139663438386462', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139663438386462', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-989545255',display_name='tempest-TestVolumeBootPattern-volume-backed-server-989545255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-989545255',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvXVOGVXF4felhnV1SHfgOVwnMWA6E80FIaviOwjEOOBCRv+KBW+7MNtmKk0ltP4o7PKQr4AdnJESqVmUgWOwmfMFieHjeuiRNZc1V4wwrOpAN2QPiYEO6nnTduR650pg==',key_name='tempest-keypair-458617660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-vh473jfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246e22061eb47eda51b4b6634102922',uuid=6c79afac-4015-4d1b-beb5-ee59d051da3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c79afac-4015-4d1b-beb5-ee59d051da3c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:43:19 user nova-compute[72405]:   <uuid>6c79afac-4015-4d1b-beb5-ee59d051da3c</uuid>
Aug 08 23:43:19 user nova-compute[72405]:   <name>instance-00000029</name>
Aug 08 23:43:19 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:43:19 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:43:19 user nova-compute[72405]:   <metadata>
Aug 08 23:43:19 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:43:19 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:43:19 user nova-compute[72405]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-989545255</nova:name>
Aug 08 23:43:19 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:43:18</nova:creationTime>
Aug 08 23:43:19 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:43:19 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:43:19 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:43:19 user nova-compute[72405]:       <nova:owner>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:user uuid="a246e22061eb47eda51b4b6634102922">tempest-TestVolumeBootPattern-1873778230-project-member</nova:user>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:project uuid="bffc0496a99448ce8705555dc3ed9c45">tempest-TestVolumeBootPattern-1873778230</nova:project>
Aug 08 23:43:19 user nova-compute[72405]:       </nova:owner>
Aug 08 23:43:19 user nova-compute[72405]:       <nova:ports>
Aug 08 23:43:19 user nova-compute[72405]:         <nova:port uuid="c8837325-2bb8-4285-b48a-d5290f36d105">
Aug 08 23:43:19 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 08 23:43:19 user nova-compute[72405]:         </nova:port>
Aug 08 23:43:19 user nova-compute[72405]:       </nova:ports>
Aug 08 23:43:19 user nova-compute[72405]:     </nova:instance>
Aug 08 23:43:19 user nova-compute[72405]:   </metadata>
Aug 08 23:43:19 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:43:19 user nova-compute[72405]:     <system>
Aug 08 23:43:19 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:43:19 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:43:19 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:43:19 user nova-compute[72405]:       <entry name="serial">6c79afac-4015-4d1b-beb5-ee59d051da3c</entry>
Aug 08 23:43:19 user nova-compute[72405]:       <entry name="uuid">6c79afac-4015-4d1b-beb5-ee59d051da3c</entry>
Aug 08 23:43:19 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:43:19 user nova-compute[72405]:     </system>
Aug 08 23:43:19 user nova-compute[72405]:   </sysinfo>
Aug 08 23:43:19 user nova-compute[72405]:   <os>
Aug 08 23:43:19 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:43:19 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:43:19 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:43:19 user nova-compute[72405]:   </os>
Aug 08 23:43:19 user nova-compute[72405]:   <features>
Aug 08 23:43:19 user nova-compute[72405]:     <acpi/>
Aug 08 23:43:19 user nova-compute[72405]:     <apic/>
Aug 08 23:43:19 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:43:19 user nova-compute[72405]:   </features>
Aug 08 23:43:19 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:43:19 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:43:19 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:43:19 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:43:19 user nova-compute[72405]:   </clock>
Aug 08 23:43:19 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:43:19 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:43:19 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:43:19 user nova-compute[72405]:   </cpu>
Aug 08 23:43:19 user nova-compute[72405]:   <devices>
Aug 08 23:43:19 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:43:19 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:43:19 user nova-compute[72405]:       <source dev="/dev/sdd"/>
Aug 08 23:43:19 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:43:19 user nova-compute[72405]:       <serial>104ea5aa-8da3-4871-afd2-c3f8afdb87d6</serial>
Aug 08 23:43:19 user nova-compute[72405]:     </disk>
Aug 08 23:43:19 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:43:19 user nova-compute[72405]:       <mac address="fa:16:3e:2f:e2:32"/>
Aug 08 23:43:19 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:43:19 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:43:19 user nova-compute[72405]:       <target dev="tapc8837325-2b"/>
Aug 08 23:43:19 user nova-compute[72405]:     </interface>
Aug 08 23:43:19 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:43:19 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/6c79afac-4015-4d1b-beb5-ee59d051da3c/console.log" append="off"/>
Aug 08 23:43:19 user nova-compute[72405]:     </serial>
Aug 08 23:43:19 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:43:19 user nova-compute[72405]:     <video>
Aug 08 23:43:19 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:43:19 user nova-compute[72405]:     </video>
Aug 08 23:43:19 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:43:19 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:43:19 user nova-compute[72405]:     </rng>
Aug 08 23:43:19 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:43:19 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:43:19 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:43:19 user nova-compute[72405]:     </memballoon>
Aug 08 23:43:19 user nova-compute[72405]:   </devices>
Aug 08 23:43:19 user nova-compute[72405]: </domain>
Aug 08 23:43:19 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-989545255',display_name='tempest-TestVolumeBootPattern-volume-backed-server-989545255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-989545255',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvXVOGVXF4felhnV1SHfgOVwnMWA6E80FIaviOwjEOOBCRv+KBW+7MNtmKk0ltP4o7PKQr4AdnJESqVmUgWOwmfMFieHjeuiRNZc1V4wwrOpAN2QPiYEO6nnTduR650pg==',key_name='tempest-keypair-458617660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-vh473jfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246e22061eb47eda51b4b6634102922',uuid=6c79afac-4015-4d1b-beb5-ee59d051da3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG os_vif [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8837325-2b, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8837325-2b, col_values=(('external_ids', {'iface-id': 'c8837325-2bb8-4285-b48a-d5290f36d105', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e2:32', 'vm-uuid': '6c79afac-4015-4d1b-beb5-ee59d051da3c'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:19 user nova-compute[72405]: INFO os_vif [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b')
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:43:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No VIF found with MAC fa:16:3e:2f:e2:32, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:43:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-a561fd61-c5d1-49a8-b355-e704df59c49f req-c985e008-5edd-4a8c-8ee1-5c0a9b9ec5f9 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a561fd61-c5d1-49a8-b355-e704df59c49f req-c985e008-5edd-4a8c-8ee1-5c0a9b9ec5f9 service nova] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a561fd61-c5d1-49a8-b355-e704df59c49f req-c985e008-5edd-4a8c-8ee1-5c0a9b9ec5f9 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a561fd61-c5d1-49a8-b355-e704df59c49f req-c985e008-5edd-4a8c-8ee1-5c0a9b9ec5f9 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG nova.compute.manager [req-a561fd61-c5d1-49a8-b355-e704df59c49f req-c985e008-5edd-4a8c-8ee1-5c0a9b9ec5f9 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] No waiting events found dispatching network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:21 user nova-compute[72405]: WARNING nova.compute.manager [req-a561fd61-c5d1-49a8-b355-e704df59c49f req-c985e008-5edd-4a8c-8ee1-5c0a9b9ec5f9 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received unexpected event network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 for instance with vm_state building and task_state spawning.
Aug 08 23:43:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-1b03bc14-518c-42b3-8e44-b3ef40941736 req-59f05875-c45d-4d2d-ac1e-cd3fbed3f9e0 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1b03bc14-518c-42b3-8e44-b3ef40941736 req-59f05875-c45d-4d2d-ac1e-cd3fbed3f9e0 service nova] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1b03bc14-518c-42b3-8e44-b3ef40941736 req-59f05875-c45d-4d2d-ac1e-cd3fbed3f9e0 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1b03bc14-518c-42b3-8e44-b3ef40941736 req-59f05875-c45d-4d2d-ac1e-cd3fbed3f9e0 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-1b03bc14-518c-42b3-8e44-b3ef40941736 req-59f05875-c45d-4d2d-ac1e-cd3fbed3f9e0 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] No waiting events found dispatching network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:23 user nova-compute[72405]: WARNING nova.compute.manager [req-1b03bc14-518c-42b3-8e44-b3ef40941736 req-59f05875-c45d-4d2d-ac1e-cd3fbed3f9e0 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received unexpected event network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 for instance with vm_state building and task_state spawning.
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538203.3741064, 6c79afac-4015-4d1b-beb5-ee59d051da3c => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] VM Resumed (Lifecycle Event)
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Instance spawned successfully.
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538203.3831222, 6c79afac-4015-4d1b-beb5-ee59d051da3c => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] VM Started (Lifecycle Event)
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 08 23:43:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:23 user nova-compute[72405]: INFO nova.compute.manager [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Took 15.19 seconds to build instance.
Aug 08 23:43:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-add9d37c-4b5d-4cf6-8496-5b2efb5985c2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.292s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:24 user nova-compute[72405]: INFO nova.compute.manager [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Rebooting instance
Aug 08 23:43:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:24 user nova-compute[72405]: DEBUG nova.network.neutron [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:43:25 user nova-compute[72405]: DEBUG nova.network.neutron [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-b1d80853-af5c-47b6-a292-f56a1ba75b6e req-19baa0ca-495e-4e53-8070-67c6222074dc service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-unplugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b1d80853-af5c-47b6-a292-f56a1ba75b6e req-19baa0ca-495e-4e53-8070-67c6222074dc service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b1d80853-af5c-47b6-a292-f56a1ba75b6e req-19baa0ca-495e-4e53-8070-67c6222074dc service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b1d80853-af5c-47b6-a292-f56a1ba75b6e req-19baa0ca-495e-4e53-8070-67c6222074dc service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-b1d80853-af5c-47b6-a292-f56a1ba75b6e req-19baa0ca-495e-4e53-8070-67c6222074dc service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-unplugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:26 user nova-compute[72405]: WARNING nova.compute.manager [req-b1d80853-af5c-47b6-a292-f56a1ba75b6e req-19baa0ca-495e-4e53-8070-67c6222074dc service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-unplugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state active and task_state reboot_started_hard.
Aug 08 23:43:26 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance destroyed successfully.
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.objects.instance [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'resources' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432474525',display_name='tempest-TestMinimumBasicScenario-server-1432474525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432474525',id=40,image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgt4050aHARdirQc1Zr73iuQ5SYeoOvZ6Vv7qfr5DKJZItgqJnGwVptVA4SqAnIB5mbi0MOa0U2cnTNpoKRmXzfLvUu/tPy1iSb20aWhUUlCS/nxbnnn1fYj5aZZ73xQ==',key_name='tempest-TestMinimumBasicScenario-1617196526',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-tbgg99tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:43:26Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=2e065384-ed86-48da-a709-3d657b017a79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfc247d1-87, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:26 user nova-compute[72405]: INFO os_vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87')
Aug 08 23:43:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:43:26 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4f8e2-bee2-4b88-9340-0469cd1f58c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[131e2d67-4c00-4a9f-a65b-afc1ed173ba5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:26 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:26 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:26 user nova-compute[72405]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:26 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7be3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4098810a-b718-4735-abbb-dc7998c1d4a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbf3d34-81f6-4d39-b49f-b1dee5d47f8a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[38902de1-2559-4819-a72e-5fcb940b3c26]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[70723824-bc0f-40ff-9b1f-b06d90aadd16]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b06b4c-5c85-4382-bae7-a62871721f7f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52f0397-3280-4ebd-aee7-d410c0de5362]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]
Aug 08 23:43:27 user nova-compute[72405]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[af755006-7352-4172-bbf3-df1bd5e3ceea]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== disconnect_volume: return (350ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Start _get_guest_xml network_info=[{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0bc649c0-039a-4752-8e1f-64bc5c95c3ba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '0bc649c0-039a-4752-8e1f-64bc5c95c3ba'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a5a04659-0d5e-4c63-866d-3951c691f607', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2e065384-ed86-48da-a709-3d657b017a79', 'attached_at': '', 'detached_at': '', 'volume_id': '55c49ca9-8576-4276-9e38-5777dcfb21c2', 'serial': '55c49ca9-8576-4276-9e38-5777dcfb21c2'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:43:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0bc649c0-039a-4752-8e1f-64bc5c95c3ba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:43:27 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:27 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:43:27 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:43:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c21b4-c11c-45c1-95d7-f3f673593783]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:43:27 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.083s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e22d06-68c3-4b88-88bc-c8b0a247bc7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2] added
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49eb9b-d289-4173-9843-815812b9023f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05dc88-faaa-4913-8a1d-5e0da72c3d36]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qoIXxkOU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qoIXxkOU" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f64d71f-7a2d-4649-8079-7638f1bdca87]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qoIXxkOU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13ffd32-ed19-40d6-914a-aed132663278]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b775107c-1300-48b9-9cd6-ab31a0ef08ad]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae44c2-58fa-4192-b065-fe89efecc58f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]
Aug 08 23:43:27 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d7f17-c5c3-43c9-a18f-e98bf25ebdc2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a5e5b8-578d-44e2-85e6-81ea67237191]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:43:27 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db876e-e75f-4d2d-85b0-06fb3b06b9be]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:43:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-fcd57526-f120-477e-9303-d22250497330 req-156746bb-e4c6-42c4-8bda-60b1ad343203 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fcd57526-f120-477e-9303-d22250497330 req-156746bb-e4c6-42c4-8bda-60b1ad343203 service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fcd57526-f120-477e-9303-d22250497330 req-156746bb-e4c6-42c4-8bda-60b1ad343203 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fcd57526-f120-477e-9303-d22250497330 req-156746bb-e4c6-42c4-8bda-60b1ad343203 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-fcd57526-f120-477e-9303-d22250497330 req-156746bb-e4c6-42c4-8bda-60b1ad343203 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:28 user nova-compute[72405]: WARNING nova.compute.manager [req-fcd57526-f120-477e-9303-d22250497330 req-156746bb-e4c6-42c4-8bda-60b1ad343203 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state active and task_state reboot_started_hard.
Aug 08 23:43:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26638353464393663', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353464393663', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432474525',display_name='tempest-TestMinimumBasicScenario-server-1432474525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432474525',id=40,image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgt4050aHARdirQc1Zr73iuQ5SYeoOvZ6Vv7qfr5DKJZItgqJnGwVptVA4SqAnIB5mbi0MOa0U2cnTNpoKRmXzfLvUu/tPy1iSb20aWhUUlCS/nxbnnn1fYj5aZZ73xQ==',key_name='tempest-TestMinimumBasicScenario-1617196526',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-tbgg99tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:43:26Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=2e065384-ed86-48da-a709-3d657b017a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.objects.instance [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:43:28 user nova-compute[72405]:   <uuid>2e065384-ed86-48da-a709-3d657b017a79</uuid>
Aug 08 23:43:28 user nova-compute[72405]:   <name>instance-00000028</name>
Aug 08 23:43:28 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:43:28 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:43:28 user nova-compute[72405]:   <metadata>
Aug 08 23:43:28 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:43:28 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:43:28 user nova-compute[72405]:       <nova:name>tempest-TestMinimumBasicScenario-server-1432474525</nova:name>
Aug 08 23:43:28 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:43:27</nova:creationTime>
Aug 08 23:43:28 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:43:28 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:43:28 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:43:28 user nova-compute[72405]:       <nova:owner>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:user uuid="13ba98961cad44b0a1246d7d7aaf1e9a">tempest-TestMinimumBasicScenario-511149043-project-member</nova:user>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:project uuid="dd2fb572f9cd475e91d08e349f2b1320">tempest-TestMinimumBasicScenario-511149043</nova:project>
Aug 08 23:43:28 user nova-compute[72405]:       </nova:owner>
Aug 08 23:43:28 user nova-compute[72405]:       <nova:root type="image" uuid="0bc649c0-039a-4752-8e1f-64bc5c95c3ba"/>
Aug 08 23:43:28 user nova-compute[72405]:       <nova:ports>
Aug 08 23:43:28 user nova-compute[72405]:         <nova:port uuid="bfc247d1-871f-46d3-9407-1f1ddfe4b5e9">
Aug 08 23:43:28 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 08 23:43:28 user nova-compute[72405]:         </nova:port>
Aug 08 23:43:28 user nova-compute[72405]:       </nova:ports>
Aug 08 23:43:28 user nova-compute[72405]:     </nova:instance>
Aug 08 23:43:28 user nova-compute[72405]:   </metadata>
Aug 08 23:43:28 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:43:28 user nova-compute[72405]:     <system>
Aug 08 23:43:28 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:43:28 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:43:28 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:43:28 user nova-compute[72405]:       <entry name="serial">2e065384-ed86-48da-a709-3d657b017a79</entry>
Aug 08 23:43:28 user nova-compute[72405]:       <entry name="uuid">2e065384-ed86-48da-a709-3d657b017a79</entry>
Aug 08 23:43:28 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:43:28 user nova-compute[72405]:     </system>
Aug 08 23:43:28 user nova-compute[72405]:   </sysinfo>
Aug 08 23:43:28 user nova-compute[72405]:   <os>
Aug 08 23:43:28 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:43:28 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:43:28 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:43:28 user nova-compute[72405]:   </os>
Aug 08 23:43:28 user nova-compute[72405]:   <features>
Aug 08 23:43:28 user nova-compute[72405]:     <acpi/>
Aug 08 23:43:28 user nova-compute[72405]:     <apic/>
Aug 08 23:43:28 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:43:28 user nova-compute[72405]:   </features>
Aug 08 23:43:28 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:43:28 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:43:28 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:43:28 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:43:28 user nova-compute[72405]:   </clock>
Aug 08 23:43:28 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:43:28 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:43:28 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:43:28 user nova-compute[72405]:   </cpu>
Aug 08 23:43:28 user nova-compute[72405]:   <devices>
Aug 08 23:43:28 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:43:28 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:43:28 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk"/>
Aug 08 23:43:28 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:43:28 user nova-compute[72405]:     </disk>
Aug 08 23:43:28 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:43:28 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:43:28 user nova-compute[72405]:       <source dev="/dev/sdc"/>
Aug 08 23:43:28 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:43:28 user nova-compute[72405]:       <serial>55c49ca9-8576-4276-9e38-5777dcfb21c2</serial>
Aug 08 23:43:28 user nova-compute[72405]:     </disk>
Aug 08 23:43:28 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:43:28 user nova-compute[72405]:       <mac address="fa:16:3e:3e:2c:45"/>
Aug 08 23:43:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:43:28 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:43:28 user nova-compute[72405]:       <target dev="tapbfc247d1-87"/>
Aug 08 23:43:28 user nova-compute[72405]:     </interface>
Aug 08 23:43:28 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:43:28 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/console.log" append="off"/>
Aug 08 23:43:28 user nova-compute[72405]:     </serial>
Aug 08 23:43:28 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:43:28 user nova-compute[72405]:     <video>
Aug 08 23:43:28 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:43:28 user nova-compute[72405]:     </video>
Aug 08 23:43:28 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:43:28 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:43:28 user nova-compute[72405]:     </rng>
Aug 08 23:43:28 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:43:28 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:43:28 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:43:28 user nova-compute[72405]:     </memballoon>
Aug 08 23:43:28 user nova-compute[72405]:   </devices>
Aug 08 23:43:28 user nova-compute[72405]: </domain>
Aug 08 23:43:28 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:43:28 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Cannot resize image /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'migration_context' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432474525',display_name='tempest-TestMinimumBasicScenario-server-1432474525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432474525',id=40,image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgt4050aHARdirQc1Zr73iuQ5SYeoOvZ6Vv7qfr5DKJZItgqJnGwVptVA4SqAnIB5mbi0MOa0U2cnTNpoKRmXzfLvUu/tPy1iSb20aWhUUlCS/nxbnnn1fYj5aZZ73xQ==',key_name='tempest-TestMinimumBasicScenario-1617196526',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-tbgg99tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:43:26Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=2e065384-ed86-48da-a709-3d657b017a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG os_vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfc247d1-87, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfc247d1-87, col_values=(('external_ids', {'iface-id': 'bfc247d1-871f-46d3-9407-1f1ddfe4b5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:2c:45', 'vm-uuid': '2e065384-ed86-48da-a709-3d657b017a79'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:43:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:29 user nova-compute[72405]: INFO os_vif [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87')
Aug 08 23:43:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-893f3840-b062-447a-ba6c-9ad97d79c054 req-62d57b38-cafa-4af6-be2e-d06da53f457b service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-893f3840-b062-447a-ba6c-9ad97d79c054 req-62d57b38-cafa-4af6-be2e-d06da53f457b service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-893f3840-b062-447a-ba6c-9ad97d79c054 req-62d57b38-cafa-4af6-be2e-d06da53f457b service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-893f3840-b062-447a-ba6c-9ad97d79c054 req-62d57b38-cafa-4af6-be2e-d06da53f457b service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG nova.compute.manager [req-893f3840-b062-447a-ba6c-9ad97d79c054 req-62d57b38-cafa-4af6-be2e-d06da53f457b service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:31 user nova-compute[72405]: WARNING nova.compute.manager [req-893f3840-b062-447a-ba6c-9ad97d79c054 req-62d57b38-cafa-4af6-be2e-d06da53f457b service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state active and task_state reboot_started_hard.
Aug 08 23:43:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.compute.claims [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Claim successful on node user
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 2e065384-ed86-48da-a709-3d657b017a79 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538213.7214725, 2e065384-ed86-48da-a709-3d657b017a79 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] VM Resumed (Lifecycle Event)
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance rebooted successfully.
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538213.7222683, 2e065384-ed86-48da-a709-3d657b017a79 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] VM Started (Lifecycle Event)
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-89a30407-5e31-44e2-ba09-792ff24b6830 req-9fdf8807-4175-4b9c-93ec-01f203e1c109 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-89a30407-5e31-44e2-ba09-792ff24b6830 req-9fdf8807-4175-4b9c-93ec-01f203e1c109 service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-89a30407-5e31-44e2-ba09-792ff24b6830 req-9fdf8807-4175-4b9c-93ec-01f203e1c109 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-89a30407-5e31-44e2-ba09-792ff24b6830 req-9fdf8807-4175-4b9c-93ec-01f203e1c109 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [req-89a30407-5e31-44e2-ba09-792ff24b6830 req-9fdf8807-4175-4b9c-93ec-01f203e1c109 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:33 user nova-compute[72405]: WARNING nova.compute.manager [req-89a30407-5e31-44e2-ba09-792ff24b6830 req-9fdf8807-4175-4b9c-93ec-01f203e1c109 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state active and task_state reboot_started_hard.
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-25a2feb7-f74d-41a6-a060-cb3de8ca1731 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.975s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.policy [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8588adf046ef40e79ff6e840261510f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a46f0ded804d8990fdfaa0c4f88254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:43:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Creating image(s)
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "/opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "/opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "/opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk 1073741824" returned: 0 in 0.059s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Successfully created port: f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Cannot resize image /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'migration_context' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Ensure instance console log exists: /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Successfully updated port: f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquired lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating instance_info_cache with network_info: [{"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Releasing lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Instance network_info: |[{"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Start _get_guest_xml network_info=[{"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:43:35 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:35 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2035139068',display_name='tempest-SnapshotDataIntegrityTests-server-2035139068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2035139068',id=42,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8EBWNnfbvP4DI3cYCDC1Y4eckA+FejcIKogLPuWgGn4jk8CLVjiQFPnNmwpxmlgyeXKcWm0acsicn53X6Vtw6Cw2h75FLsaJEdydvypqY3ovYI4nAQXzF43+uKjwSpxg==',key_name='tempest-keypair-22172130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47a46f0ded804d8990fdfaa0c4f88254',ramdisk_id='',reservation_id='r-s7e5dg47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-794286815',owner_user_name='tempest-SnapshotDataIntegrityTests-794286815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8588adf046ef40e79ff6e840261510f8',uuid=482d453c-fbe5-4f41-8454-e290767220ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Converting VIF {"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'pci_devices' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-changed-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Refreshing instance network info cache due to event network-changed-f5ad7ceb-586f-46af-9461-a31ff59bf87e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] Acquiring lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] Acquired lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:35 user nova-compute[72405]: DEBUG nova.network.neutron [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Refreshing network info cache for port f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:43:36 user nova-compute[72405]:   <uuid>482d453c-fbe5-4f41-8454-e290767220ed</uuid>
Aug 08 23:43:36 user nova-compute[72405]:   <name>instance-0000002a</name>
Aug 08 23:43:36 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:43:36 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:43:36 user nova-compute[72405]:   <metadata>
Aug 08 23:43:36 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:43:36 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:43:36 user nova-compute[72405]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2035139068</nova:name>
Aug 08 23:43:36 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:43:35</nova:creationTime>
Aug 08 23:43:36 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:43:36 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:43:36 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:43:36 user nova-compute[72405]:       <nova:owner>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:user uuid="8588adf046ef40e79ff6e840261510f8">tempest-SnapshotDataIntegrityTests-794286815-project-member</nova:user>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:project uuid="47a46f0ded804d8990fdfaa0c4f88254">tempest-SnapshotDataIntegrityTests-794286815</nova:project>
Aug 08 23:43:36 user nova-compute[72405]:       </nova:owner>
Aug 08 23:43:36 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:43:36 user nova-compute[72405]:       <nova:ports>
Aug 08 23:43:36 user nova-compute[72405]:         <nova:port uuid="f5ad7ceb-586f-46af-9461-a31ff59bf87e">
Aug 08 23:43:36 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:43:36 user nova-compute[72405]:         </nova:port>
Aug 08 23:43:36 user nova-compute[72405]:       </nova:ports>
Aug 08 23:43:36 user nova-compute[72405]:     </nova:instance>
Aug 08 23:43:36 user nova-compute[72405]:   </metadata>
Aug 08 23:43:36 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:43:36 user nova-compute[72405]:     <system>
Aug 08 23:43:36 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:43:36 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:43:36 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:43:36 user nova-compute[72405]:       <entry name="serial">482d453c-fbe5-4f41-8454-e290767220ed</entry>
Aug 08 23:43:36 user nova-compute[72405]:       <entry name="uuid">482d453c-fbe5-4f41-8454-e290767220ed</entry>
Aug 08 23:43:36 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:43:36 user nova-compute[72405]:     </system>
Aug 08 23:43:36 user nova-compute[72405]:   </sysinfo>
Aug 08 23:43:36 user nova-compute[72405]:   <os>
Aug 08 23:43:36 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:43:36 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:43:36 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:43:36 user nova-compute[72405]:   </os>
Aug 08 23:43:36 user nova-compute[72405]:   <features>
Aug 08 23:43:36 user nova-compute[72405]:     <acpi/>
Aug 08 23:43:36 user nova-compute[72405]:     <apic/>
Aug 08 23:43:36 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:43:36 user nova-compute[72405]:   </features>
Aug 08 23:43:36 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:43:36 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:43:36 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:43:36 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:43:36 user nova-compute[72405]:   </clock>
Aug 08 23:43:36 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:43:36 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:43:36 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:43:36 user nova-compute[72405]:   </cpu>
Aug 08 23:43:36 user nova-compute[72405]:   <devices>
Aug 08 23:43:36 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:43:36 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:43:36 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk"/>
Aug 08 23:43:36 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:43:36 user nova-compute[72405]:     </disk>
Aug 08 23:43:36 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:43:36 user nova-compute[72405]:       <mac address="fa:16:3e:1d:c3:fb"/>
Aug 08 23:43:36 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:43:36 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:43:36 user nova-compute[72405]:       <target dev="tapf5ad7ceb-58"/>
Aug 08 23:43:36 user nova-compute[72405]:     </interface>
Aug 08 23:43:36 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:43:36 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/console.log" append="off"/>
Aug 08 23:43:36 user nova-compute[72405]:     </serial>
Aug 08 23:43:36 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:43:36 user nova-compute[72405]:     <video>
Aug 08 23:43:36 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:43:36 user nova-compute[72405]:     </video>
Aug 08 23:43:36 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:43:36 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:43:36 user nova-compute[72405]:     </rng>
Aug 08 23:43:36 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:43:36 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:43:36 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:43:36 user nova-compute[72405]:     </memballoon>
Aug 08 23:43:36 user nova-compute[72405]:   </devices>
Aug 08 23:43:36 user nova-compute[72405]: </domain>
Aug 08 23:43:36 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2035139068',display_name='tempest-SnapshotDataIntegrityTests-server-2035139068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2035139068',id=42,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8EBWNnfbvP4DI3cYCDC1Y4eckA+FejcIKogLPuWgGn4jk8CLVjiQFPnNmwpxmlgyeXKcWm0acsicn53X6Vtw6Cw2h75FLsaJEdydvypqY3ovYI4nAQXzF43+uKjwSpxg==',key_name='tempest-keypair-22172130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47a46f0ded804d8990fdfaa0c4f88254',ramdisk_id='',reservation_id='r-s7e5dg47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-794286815',owner_user_name='tempest-SnapshotDataIntegrityTests-794286815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8588adf046ef40e79ff6e840261510f8',uuid=482d453c-fbe5-4f41-8454-e290767220ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Converting VIF {"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG os_vif [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5ad7ceb-58, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5ad7ceb-58, col_values=(('external_ids', {'iface-id': 'f5ad7ceb-586f-46af-9461-a31ff59bf87e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:c3:fb', 'vm-uuid': '482d453c-fbe5-4f41-8454-e290767220ed'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:36 user nova-compute[72405]: INFO os_vif [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58')
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No VIF found with MAC fa:16:3e:1d:c3:fb, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.network.neutron [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updated VIF entry in instance network info cache for port f5ad7ceb-586f-46af-9461-a31ff59bf87e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG nova.network.neutron [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating instance_info_cache with network_info: [{"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f19aa49-07ea-4950-a0db-da041a4c06a0 req-0ed0d2db-eb04-43af-b9fe-7089aff1f085 service nova] Releasing lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-0ba7cb5f-6c3a-4ed2-867d-33d1cdda7e41 req-2258078d-403e-4e65-86ce-f20b06350cd9 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0ba7cb5f-6c3a-4ed2-867d-33d1cdda7e41 req-2258078d-403e-4e65-86ce-f20b06350cd9 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0ba7cb5f-6c3a-4ed2-867d-33d1cdda7e41 req-2258078d-403e-4e65-86ce-f20b06350cd9 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0ba7cb5f-6c3a-4ed2-867d-33d1cdda7e41 req-2258078d-403e-4e65-86ce-f20b06350cd9 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.012s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-0ba7cb5f-6c3a-4ed2-867d-33d1cdda7e41 req-2258078d-403e-4e65-86ce-f20b06350cd9 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:38 user nova-compute[72405]: WARNING nova.compute.manager [req-0ba7cb5f-6c3a-4ed2-867d-33d1cdda7e41 req-2258078d-403e-4e65-86ce-f20b06350cd9 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received unexpected event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with vm_state building and task_state spawning.
Aug 08 23:43:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:39 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:43:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-8cf5c11e-7dfa-4a01-9ce9-b21a1a873fdb req-420e0388-98fb-45c0-a6a6-6f63d5ac126b service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8cf5c11e-7dfa-4a01-9ce9-b21a1a873fdb req-420e0388-98fb-45c0-a6a6-6f63d5ac126b service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8cf5c11e-7dfa-4a01-9ce9-b21a1a873fdb req-420e0388-98fb-45c0-a6a6-6f63d5ac126b service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8cf5c11e-7dfa-4a01-9ce9-b21a1a873fdb req-420e0388-98fb-45c0-a6a6-6f63d5ac126b service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-8cf5c11e-7dfa-4a01-9ce9-b21a1a873fdb req-420e0388-98fb-45c0-a6a6-6f63d5ac126b service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:43:40 user nova-compute[72405]: WARNING nova.compute.manager [req-8cf5c11e-7dfa-4a01-9ce9-b21a1a873fdb req-420e0388-98fb-45c0-a6a6-6f63d5ac126b service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received unexpected event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with vm_state building and task_state spawning.
Aug 08 23:43:40 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538220.5908606, 482d453c-fbe5-4f41-8454-e290767220ed => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] VM Resumed (Lifecycle Event)
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Instance spawned successfully.
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538220.592128, 482d453c-fbe5-4f41-8454-e290767220ed => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] VM Started (Lifecycle Event)
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Took 6.88 seconds to spawn the instance on the hypervisor.
Aug 08 23:43:40 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:43:40 user nova-compute[72405]: INFO nova.compute.manager [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Took 7.66 seconds to build instance.
Aug 08 23:43:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fa3a76ed-4f87-4031-8d4e-eabd9c413dca tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.839s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:43 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:43 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:43:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:43:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:43:43 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:43:44 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [{"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:43:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-855c4ef2-9d79-4495-8dd4-21b8ae09e04f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:43:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:43:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:43:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:43:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=25.20915985107422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2e065384-ed86-48da-a709-3d657b017a79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6c79afac-4015-4d1b-beb5-ee59d051da3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:43:50 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:43:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:43:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:43:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:43:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:43:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:43:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:43:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:07 user nova-compute[72405]: INFO nova.compute.manager [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Terminating instance
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-8b8fc251-358c-4bee-b067-c3d4a0a1d36f req-af9e0e96-8c9c-4282-84eb-24e6018b4667 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8b8fc251-358c-4bee-b067-c3d4a0a1d36f req-af9e0e96-8c9c-4282-84eb-24e6018b4667 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8b8fc251-358c-4bee-b067-c3d4a0a1d36f req-af9e0e96-8c9c-4282-84eb-24e6018b4667 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8b8fc251-358c-4bee-b067-c3d4a0a1d36f req-af9e0e96-8c9c-4282-84eb-24e6018b4667 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-8b8fc251-358c-4bee-b067-c3d4a0a1d36f req-af9e0e96-8c9c-4282-84eb-24e6018b4667 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-8b8fc251-358c-4bee-b067-c3d4a0a1d36f req-af9e0e96-8c9c-4282-84eb-24e6018b4667 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-unplugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:44:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Instance destroyed successfully.
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'resources' on Instance uuid 855c4ef2-9d79-4495-8dd4-21b8ae09e04f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-20453789',display_name='tempest-ServerActionsTestOtherA-server-20453789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-20453789',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-1ub2fet6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=855c4ef2-9d79-4495-8dd4-21b8ae09e04f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "address": "fa:16:3e:e7:e9:e5", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b2fc0e-b8", "ovs_interfaceid": "27b2fc0e-b8bc-451c-89ed-5be2550f0e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_vif [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b2fc0e-b8, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:44:07 user nova-compute[72405]: INFO os_vif [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=27b2fc0e-b8bc-451c-89ed-5be2550f0e80,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b2fc0e-b8')
Aug 08 23:44:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBoSZEHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:44:07 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c7507-4e0b-4756-8404-ec61d7347e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85eca0-53be-46ec-9b23-dfa98d217a9d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:44:07 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:44:07 user nova-compute[72405]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:44:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 (non-flash)
Aug 08 23:44:07 user nova-compute[72405]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:44:07 user nova-compute[72405]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:44:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb78198280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25c0fe-da09-429c-a0c1-1ad758ed81dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d0e8e-6ca7-4048-99d0-2a26a1a11223]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[036d2477-b6e8-4626-81c7-f49fb0929875]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:44:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7176af0-0ed3-46e2-a650-54ad554fcc38]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2aba4-bbdf-441d-bfc5-a6d89d863ac3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda59683-7257-4f64-a378-9d6608dfc477]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260]
Aug 08 23:44:08 user nova-compute[72405]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62, portal: 172.16.0.220,3260] successful.
Aug 08 23:44:08 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a0cb73-0e44-4b84-a140-fabe8da72e62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[59146101-27cf-4a65-9016-2ffb02ae1c27]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] <== disconnect_volume: return (294ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:44:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Deleting instance files /opt/stack/data/nova/instances/855c4ef2-9d79-4495-8dd4-21b8ae09e04f_del
Aug 08 23:44:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Deletion of /opt/stack/data/nova/instances/855c4ef2-9d79-4495-8dd4-21b8ae09e04f_del complete
Aug 08 23:44:08 user nova-compute[72405]: INFO nova.compute.manager [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 08 23:44:08 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:44:08 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:44:09 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Took 0.86 seconds to deallocate network for instance.
Aug 08 23:44:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] Acquiring lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] No waiting events found dispatching network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:44:09 user nova-compute[72405]: WARNING nova.compute.manager [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received unexpected event network-vif-plugged-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 for instance with vm_state active and task_state deleting.
Aug 08 23:44:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-1ff8203a-11eb-4561-87c0-9c3262df3e26 req-5f3f2d86-527f-40d1-b8a5-2b6087a547f4 service nova] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Received event network-vif-deleted-27b2fc0e-b8bc-451c-89ed-5be2550f0e80 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:09 user nova-compute[72405]: INFO nova.compute.manager [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Took 0.79 seconds to detach 1 volumes for instance.
Aug 08 23:44:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Deleting volume: e3a0cb73-0e44-4b84-a140-fabe8da72e62 {{(pid=72405) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:10 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:44:10 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:44:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:10 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Deleted allocations for instance 855c4ef2-9d79-4495-8dd4-21b8ae09e04f
Aug 08 23:44:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b419f3f6-a385-4173-9804-7aba36e65d57 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "855c4ef2-9d79-4495-8dd4-21b8ae09e04f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.332s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538247.8121803, 855c4ef2-9d79-4495-8dd4-21b8ae09e04f => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:44:22 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] VM Stopped (Lifecycle Event)
Aug 08 23:44:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-aa175561-e3b1-4333-99a1-ea3ec0a4f660 None None] [instance: 855c4ef2-9d79-4495-8dd4-21b8ae09e04f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:44:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:44:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:44:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:40 user nova-compute[72405]: INFO nova.compute.manager [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Unrescuing
Aug 08 23:44:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:44:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:44:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'flavor' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-6ea9f005-d967-4201-ac8b-bf8a454f9e59 req-d030b5fc-7378-4cb8-8fa0-28a60560b9e4 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6ea9f005-d967-4201-ac8b-bf8a454f9e59 req-d030b5fc-7378-4cb8-8fa0-28a60560b9e4 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6ea9f005-d967-4201-ac8b-bf8a454f9e59 req-d030b5fc-7378-4cb8-8fa0-28a60560b9e4 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6ea9f005-d967-4201-ac8b-bf8a454f9e59 req-d030b5fc-7378-4cb8-8fa0-28a60560b9e4 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-6ea9f005-d967-4201-ac8b-bf8a454f9e59 req-d030b5fc-7378-4cb8-8fa0-28a60560b9e4 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:44:41 user nova-compute[72405]: WARNING nova.compute.manager [req-6ea9f005-d967-4201-ac8b-bf8a454f9e59 req-d030b5fc-7378-4cb8-8fa0-28a60560b9e4 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:44:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:41 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance destroyed successfully.
Aug 08 23:44:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:44:43 user nova-compute[72405]: WARNING nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:44:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:44:43 user nova-compute[72405]: WARNING nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:44:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:44:43 user nova-compute[72405]: WARNING nova.compute.manager [req-8865d886-4b52-4553-aae2-256dd6522138 req-34a10a83-64bf-4f5d-bbed-447be34fc551 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:44:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 04f2ae79-2d01-4a28-888c-93b50bc61a07 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538285.7210548, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:44:45 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Resumed (Lifecycle Event)
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d907214d-4fff-4d2d-94fe-b5a6f65dd03e tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:44:45 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538285.7228382, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:44:45 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Started (Lifecycle Event)
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:44:45 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:44:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:44:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:44:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:44:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:44:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:44:52 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:44:52 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.178356170654297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2e065384-ed86-48da-a709-3d657b017a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6c79afac-4015-4d1b-beb5-ee59d051da3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:44:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:44:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:44:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-changed-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:44:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Refreshing instance network info cache due to event network-changed-c8837325-2bb8-4285-b48a-d5290f36d105. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:44:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] Acquiring lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:44:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] Acquired lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:44:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Refreshing network info cache for port c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:45:00 user nova-compute[72405]: DEBUG nova.network.neutron [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updated VIF entry in instance network info cache for port c8837325-2bb8-4285-b48a-d5290f36d105. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:45:00 user nova-compute[72405]: DEBUG nova.network.neutron [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updating instance_info_cache with network_info: [{"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-443e2b7a-85ae-4cf3-96aa-277b5aab9867 req-0041e2fa-1475-4471-aa96-572a8733f16a service nova] Releasing lock "refresh_cache-6c79afac-4015-4d1b-beb5-ee59d051da3c" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:04 user nova-compute[72405]: INFO nova.compute.manager [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Terminating instance
Aug 08 23:45:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-ca5b35f2-7f77-4b81-bf8b-5e07d54d5ff2 req-2b1151c2-a892-4525-84df-4c1838c1b8b3 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-unplugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ca5b35f2-7f77-4b81-bf8b-5e07d54d5ff2 req-2b1151c2-a892-4525-84df-4c1838c1b8b3 service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ca5b35f2-7f77-4b81-bf8b-5e07d54d5ff2 req-2b1151c2-a892-4525-84df-4c1838c1b8b3 service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ca5b35f2-7f77-4b81-bf8b-5e07d54d5ff2 req-2b1151c2-a892-4525-84df-4c1838c1b8b3 service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-ca5b35f2-7f77-4b81-bf8b-5e07d54d5ff2 req-2b1151c2-a892-4525-84df-4c1838c1b8b3 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-unplugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:45:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-ca5b35f2-7f77-4b81-bf8b-5e07d54d5ff2 req-2b1151c2-a892-4525-84df-4c1838c1b8b3 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-unplugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Instance destroyed successfully.
Aug 08 23:45:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lazy-loading 'resources' on Instance uuid e5fc6348-e237-4f86-8179-c5dc34b9e1d2 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-08T23:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525172976',display_name='tempest-ServerActionsTestOtherA-server-55724933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525172976',id=21,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYXvI9yrIanFgHL2mlzRTjvK1eis5O40WcS4zVTHIG/9s9nyDnkl3L3LEzyMtWKZntGeRKsuojpGQKyYN5vo3gpx3L/dlX2NgDepPwDhAIckMX9lVQyylljPfMbcpCsrA==',key_name='tempest-keypair-1633833990',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='628adffbe7ca403b8dc9c26f8254cddb',ramdisk_id='',reservation_id='r-eqwjzdat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1743133349',owner_user_name='tempest-ServerActionsTestOtherA-1743133349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2e4ec54172a455187e10b1b119c8cec',uuid=e5fc6348-e237-4f86-8179-c5dc34b9e1d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converting VIF {"id": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "address": "fa:16:3e:0c:91:38", "network": {"id": "cf74b354-6081-4561-94f6-57bdb4bfbbad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1330158064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628adffbe7ca403b8dc9c26f8254cddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac5523e-98", "ovs_interfaceid": "eac5523e-985c-4a32-b6a6-b75f08a00cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG os_vif [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac5523e-98, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:45:05 user nova-compute[72405]: INFO os_vif [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:91:38,bridge_name='br-int',has_traffic_filtering=True,id=eac5523e-985c-4a32-b6a6-b75f08a00cf9,network=Network(cf74b354-6081-4561-94f6-57bdb4bfbbad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac5523e-98')
Aug 08 23:45:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Deleting instance files /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2_del
Aug 08 23:45:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Deletion of /opt/stack/data/nova/instances/e5fc6348-e237-4f86-8179-c5dc34b9e1d2_del complete
Aug 08 23:45:05 user nova-compute[72405]: INFO nova.compute.manager [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 08 23:45:05 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:45:05 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:06 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Took 0.72 seconds to deallocate network for instance.
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd03d88b-84bc-4fc3-a3d0-098eca1b5cec req-96a284f0-fff7-4c31-8aed-82bc0c010ce0 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-deleted-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:06 user nova-compute[72405]: INFO nova.compute.manager [req-bd03d88b-84bc-4fc3-a3d0-098eca1b5cec req-96a284f0-fff7-4c31-8aed-82bc0c010ce0 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Neutron deleted interface eac5523e-985c-4a32-b6a6-b75f08a00cf9; detaching it from the instance and deleting it from the info cache
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.network.neutron [req-bd03d88b-84bc-4fc3-a3d0-098eca1b5cec req-96a284f0-fff7-4c31-8aed-82bc0c010ce0 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-bd03d88b-84bc-4fc3-a3d0-098eca1b5cec req-96a284f0-fff7-4c31-8aed-82bc0c010ce0 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Detach interface failed, port_id=eac5523e-985c-4a32-b6a6-b75f08a00cf9, reason: Instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:06 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Deleted allocations for instance e5fc6348-e237-4f86-8179-c5dc34b9e1d2
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-08a9bea3-bee7-4ed0-8269-179121783a69 tempest-ServerActionsTestOtherA-1743133349 tempest-ServerActionsTestOtherA-1743133349-project-member] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-34e86779-e1a4-49cd-8ef5-8937ea738c43 req-a040bb91-01d0-4d65-9b63-0146a19c7936 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-34e86779-e1a4-49cd-8ef5-8937ea738c43 req-a040bb91-01d0-4d65-9b63-0146a19c7936 service nova] Acquiring lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-34e86779-e1a4-49cd-8ef5-8937ea738c43 req-a040bb91-01d0-4d65-9b63-0146a19c7936 service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-34e86779-e1a4-49cd-8ef5-8937ea738c43 req-a040bb91-01d0-4d65-9b63-0146a19c7936 service nova] Lock "e5fc6348-e237-4f86-8179-c5dc34b9e1d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-34e86779-e1a4-49cd-8ef5-8937ea738c43 req-a040bb91-01d0-4d65-9b63-0146a19c7936 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] No waiting events found dispatching network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:45:06 user nova-compute[72405]: WARNING nova.compute.manager [req-34e86779-e1a4-49cd-8ef5-8937ea738c43 req-a040bb91-01d0-4d65-9b63-0146a19c7936 service nova] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Received unexpected event network-vif-plugged-eac5523e-985c-4a32-b6a6-b75f08a00cf9 for instance with vm_state deleted and task_state None.
Aug 08 23:45:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:45:11 user nova-compute[72405]: INFO nova.compute.claims [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Claim successful on node user
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:45:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:45:11 user nova-compute[72405]: INFO nova.virt.block_device [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Booting with volume snapshot 33772d2b-b167-47d5-b1f1-ef4693feb127 at /dev/vda
Aug 08 23:45:11 user nova-compute[72405]: DEBUG nova.policy [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246e22061eb47eda51b4b6634102922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc0496a99448ce8705555dc3ed9c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Successfully created port: 232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Successfully updated port: 232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquired lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-changed-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Refreshing instance network info cache due to event network-changed-232ed00a-f332-444d-99c7-09243be845d4. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] Acquiring lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:45:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG nova.network.neutron [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updating instance_info_cache with network_info: [{"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Releasing lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Instance network_info: |[{"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] Acquired lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Refreshing network info cache for port 232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updated VIF entry in instance network info cache for port 232ed00a-f332-444d-99c7-09243be845d4. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updating instance_info_cache with network_info: [{"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9adb834f-0161-4555-9190-dc7af8392239 req-b6e738f3-04cf-47aa-a759-2f92d7256cdf service nova] Releasing lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing instance network info cache due to event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG os_brick.utils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fb1228-f041-4fba-b53d-78a54c55ca64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[72315245-67e8-4c13-a87a-7fbb8d5ebc62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee363bc-cfaa-46e3-8bef-42930fe1da58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5198ebf-dda7-4e73-b3c7-777548dc4883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:45:17 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[28503970-dc9a-4ea7-911d-f6a713e03a43]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG os_brick.utils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updating existing volume attachment record: 7da99958-6613-46d7-aabc-3993d883ce62 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updated VIF entry in instance network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG nova.network.neutron [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4b752563-5e95-4280-85fe-38765daf3fa3 req-25dd425a-1e64-498d-9f4d-bcf7a2b51417 service nova] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing instance network info cache due to event network-changed-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] Acquiring lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] Acquired lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Refreshing network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:18 user nova-compute[72405]: INFO nova.compute.manager [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Detaching volume 55c49ca9-8576-4276-9e38-5777dcfb21c2
Aug 08 23:45:18 user nova-compute[72405]: INFO nova.virt.block_device [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Attempting to driver detach volume 55c49ca9-8576-4276-9e38-5777dcfb21c2 from mountpoint /dev/vdb
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Attempting to detach device vdb from instance 2e065384-ed86-48da-a709-3d657b017a79 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:45:18 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:45:18 user nova-compute[72405]:   <source dev="/dev/sdc"/>
Aug 08 23:45:18 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:45:18 user nova-compute[72405]:   <serial>55c49ca9-8576-4276-9e38-5777dcfb21c2</serial>
Aug 08 23:45:18 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:45:18 user nova-compute[72405]: </disk>
Aug 08 23:45:18 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:45:18 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully detached device vdb from instance 2e065384-ed86-48da-a709-3d657b017a79 from the persistent domain config.
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e065384-ed86-48da-a709-3d657b017a79 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:45:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:45:18 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:45:18 user nova-compute[72405]:   <source dev="/dev/sdc"/>
Aug 08 23:45:18 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:45:18 user nova-compute[72405]:   <serial>55c49ca9-8576-4276-9e38-5777dcfb21c2</serial>
Aug 08 23:45:18 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 08 23:45:18 user nova-compute[72405]: </disk>
Aug 08 23:45:18 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538319.2883327, 2e065384-ed86-48da-a709-3d657b017a79 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:45:19 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully detached device vdb from instance 2e065384-ed86-48da-a709-3d657b017a79 from the live domain config.
Aug 08 23:45:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoIXxkOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:45:19 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.058s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[28748ae2-edc9-4b3b-9a56-1ed519151545]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG nova.network.neutron [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updated VIF entry in instance network info cache for port bfc247d1-871f-46d3-9407-1f1ddfe4b5e9. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG nova.network.neutron [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [{"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6da87-fb2b-49cc-a052-48529f11d253]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:19 user nova-compute[72405]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:45:19 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:19 user nova-compute[72405]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 (non-flash)
Aug 08 23:45:19 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f1add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e468d01c-af0d-48c2-98b3-1204b43523e5 req-33fad7ef-08b6-4f51-9568-3c06088b096e service nova] Releasing lock "refresh_cache-2e065384-ed86-48da-a709-3d657b017a79" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fd1b9-7475-4925-ba80-326cb4a1da8a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[48036196-ead0-4274-9d6b-af02ea064206]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[20530cd6-1c05-425a-b991-bdcda2d093d1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeac00a-cfcd-4640-adee-654b34f17104]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[01120d01-b1fb-411f-a307-e1b89c2db2e6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e30d0-7cd4-4045-ab20-6f743353e82c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260]
Aug 08 23:45:19 user nova-compute[72405]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2, portal: 172.16.0.220,3260] successful.
Aug 08 23:45:19 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c49ca9-8576-4276-9e38-5777dcfb21c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[129808af-3729-4a43-b75e-8d6f8b7e2fc9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== disconnect_volume: return (334ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:45:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:45:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'flavor' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:45:20 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538305.408951, e5fc6348-e237-4f86-8179-c5dc34b9e1d2 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:45:20 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] VM Stopped (Lifecycle Event)
Aug 08 23:45:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b7928940-bc50-42f5-9b39-ac97b5a1c83e None None] [instance: e5fc6348-e237-4f86-8179-c5dc34b9e1d2] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:45:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fd9f6606-0add-4147-95fe-11261058e788 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.799s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-changed-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Refreshing instance network info cache due to event network-changed-f5ad7ceb-586f-46af-9461-a31ff59bf87e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] Acquiring lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] Acquired lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Refreshing network info cache for port f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updated VIF entry in instance network info cache for port f5ad7ceb-586f-46af-9461-a31ff59bf87e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating instance_info_cache with network_info: [{"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-65fd5075-47e8-46a4-89f4-59998abe72f9 req-255b37b5-17b8-47a1-9fa0-6a2e3aeeac15 service nova] Releasing lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:45:25 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Creating image(s)
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Ensure instance console log exists: /opt/stack/data/nova/instances/200a80f4-ddc2-4197-a0b7-3b25a2e23732/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Start _get_guest_xml network_info=[{"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-08T23:45:02Z,direct_url=<?>,disk_format='qcow2',id=69d377a2-8cbc-48b8-8299-4371a5815b18,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1918898141',owner='bffc0496a99448ce8705555dc3ed9c45',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-08T23:45:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7da99958-6613-46d7-aabc-3993d883ce62', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpycNDnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '200a80f4-ddc2-4197-a0b7-3b25a2e23732', 'attached_at': '', 'detached_at': '', 'volume_id': 'a972cfc3-f524-420b-99df-1d82ff635e76', 'serial': 'a972cfc3-f524-420b-99df-1d82ff635e76'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:45:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:45:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-08T23:45:02Z,direct_url=<?>,disk_format='qcow2',id=69d377a2-8cbc-48b8-8299-4371a5815b18,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1918898141',owner='bffc0496a99448ce8705555dc3ed9c45',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-08T23:45:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpycNDnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:45:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:45:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:45:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:45:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:45:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:45:25 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:45:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e51f2-68bc-4a71-978d-906a23516292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:45:26 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d134f0-d85d-48e0-8d8b-9782ae3eff62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76] added
Aug 08 23:45:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f7705-6bc8-4c1a-a9e0-ddd38f5fa2f7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[391609a9-3519-42f4-8e1d-222d2fb3103b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpycNDnf {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpycNDnf" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ebe680-a8f0-4a82-84dc-4a3ac57379ae]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpycNDnf'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dab855c-406e-4ea8-a19d-4d367ef85cd0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d012156-d03f-4da9-8b1c-c40caae8255e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[095d236c-f841-41f1-a00f-a3b536eae064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260]
Aug 08 23:45:26 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260] successful.
Aug 08 23:45:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3563c-6a4d-48aa-9a67-c92d8d1ade55]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150224a-17e3-41f0-8a8c-d73fea2a31eb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:26 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:45:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:26 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:45:26 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b156c74-884d-435c-ac7d-c0fd61aefeda]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:45:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpycNDnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26632646137656531', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632646137656531', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-114076471',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-114076471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-114076471',id=43,image_ref='69d377a2-8cbc-48b8-8299-4371a5815b18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJWGGtq1yXgoutt+5gUjmdrr77WUjk669rUro22YnnBCasViwP3VA0phpExkWmbGa3foZ9s2ayoSmebd/uHYmwwQm7jrroolsjjV7b6dzzn6XubvHI8uW68AcWgCckOjw==',key_name='tempest-keypair-1853198850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-at5kdup3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1873778230',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246e22061eb47eda51b4b6634102922',uuid=200a80f4-ddc2-4197-a0b7-3b25a2e23732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'pci_devices' on Instance uuid 200a80f4-ddc2-4197-a0b7-3b25a2e23732 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:45:27 user nova-compute[72405]:   <uuid>200a80f4-ddc2-4197-a0b7-3b25a2e23732</uuid>
Aug 08 23:45:27 user nova-compute[72405]:   <name>instance-0000002b</name>
Aug 08 23:45:27 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:45:27 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:45:27 user nova-compute[72405]:   <metadata>
Aug 08 23:45:27 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:45:27 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:45:27 user nova-compute[72405]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-114076471</nova:name>
Aug 08 23:45:27 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:45:25</nova:creationTime>
Aug 08 23:45:27 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:45:27 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:45:27 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:45:27 user nova-compute[72405]:       <nova:owner>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:user uuid="a246e22061eb47eda51b4b6634102922">tempest-TestVolumeBootPattern-1873778230-project-member</nova:user>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:project uuid="bffc0496a99448ce8705555dc3ed9c45">tempest-TestVolumeBootPattern-1873778230</nova:project>
Aug 08 23:45:27 user nova-compute[72405]:       </nova:owner>
Aug 08 23:45:27 user nova-compute[72405]:       <nova:root type="image" uuid="69d377a2-8cbc-48b8-8299-4371a5815b18"/>
Aug 08 23:45:27 user nova-compute[72405]:       <nova:ports>
Aug 08 23:45:27 user nova-compute[72405]:         <nova:port uuid="232ed00a-f332-444d-99c7-09243be845d4">
Aug 08 23:45:27 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 08 23:45:27 user nova-compute[72405]:         </nova:port>
Aug 08 23:45:27 user nova-compute[72405]:       </nova:ports>
Aug 08 23:45:27 user nova-compute[72405]:     </nova:instance>
Aug 08 23:45:27 user nova-compute[72405]:   </metadata>
Aug 08 23:45:27 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:45:27 user nova-compute[72405]:     <system>
Aug 08 23:45:27 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:45:27 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:45:27 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:45:27 user nova-compute[72405]:       <entry name="serial">200a80f4-ddc2-4197-a0b7-3b25a2e23732</entry>
Aug 08 23:45:27 user nova-compute[72405]:       <entry name="uuid">200a80f4-ddc2-4197-a0b7-3b25a2e23732</entry>
Aug 08 23:45:27 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:45:27 user nova-compute[72405]:     </system>
Aug 08 23:45:27 user nova-compute[72405]:   </sysinfo>
Aug 08 23:45:27 user nova-compute[72405]:   <os>
Aug 08 23:45:27 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:45:27 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:45:27 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:45:27 user nova-compute[72405]:   </os>
Aug 08 23:45:27 user nova-compute[72405]:   <features>
Aug 08 23:45:27 user nova-compute[72405]:     <acpi/>
Aug 08 23:45:27 user nova-compute[72405]:     <apic/>
Aug 08 23:45:27 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:45:27 user nova-compute[72405]:   </features>
Aug 08 23:45:27 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:45:27 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:45:27 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:45:27 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:45:27 user nova-compute[72405]:   </clock>
Aug 08 23:45:27 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:45:27 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:45:27 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:45:27 user nova-compute[72405]:   </cpu>
Aug 08 23:45:27 user nova-compute[72405]:   <devices>
Aug 08 23:45:27 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:45:27 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:45:27 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:45:27 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:45:27 user nova-compute[72405]:       <serial>a972cfc3-f524-420b-99df-1d82ff635e76</serial>
Aug 08 23:45:27 user nova-compute[72405]:     </disk>
Aug 08 23:45:27 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:45:27 user nova-compute[72405]:       <mac address="fa:16:3e:9b:03:0d"/>
Aug 08 23:45:27 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:45:27 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:45:27 user nova-compute[72405]:       <target dev="tap232ed00a-f3"/>
Aug 08 23:45:27 user nova-compute[72405]:     </interface>
Aug 08 23:45:27 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:45:27 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/200a80f4-ddc2-4197-a0b7-3b25a2e23732/console.log" append="off"/>
Aug 08 23:45:27 user nova-compute[72405]:     </serial>
Aug 08 23:45:27 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:45:27 user nova-compute[72405]:     <video>
Aug 08 23:45:27 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:45:27 user nova-compute[72405]:     </video>
Aug 08 23:45:27 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:45:27 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:45:27 user nova-compute[72405]:     </rng>
Aug 08 23:45:27 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:45:27 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:45:27 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:45:27 user nova-compute[72405]:     </memballoon>
Aug 08 23:45:27 user nova-compute[72405]:   </devices>
Aug 08 23:45:27 user nova-compute[72405]: </domain>
Aug 08 23:45:27 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-114076471',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-114076471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-114076471',id=43,image_ref='69d377a2-8cbc-48b8-8299-4371a5815b18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJWGGtq1yXgoutt+5gUjmdrr77WUjk669rUro22YnnBCasViwP3VA0phpExkWmbGa3foZ9s2ayoSmebd/uHYmwwQm7jrroolsjjV7b6dzzn6XubvHI8uW68AcWgCckOjw==',key_name='tempest-keypair-1853198850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-at5kdup3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1873778230',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246e22061eb47eda51b4b6634102922',uuid=200a80f4-ddc2-4197-a0b7-3b25a2e23732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG os_vif [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap232ed00a-f3, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap232ed00a-f3, col_values=(('external_ids', {'iface-id': '232ed00a-f332-444d-99c7-09243be845d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:03:0d', 'vm-uuid': '200a80f4-ddc2-4197-a0b7-3b25a2e23732'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:27 user nova-compute[72405]: INFO os_vif [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3')
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:45:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No VIF found with MAC fa:16:3e:9b:03:0d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-de62982b-8195-4141-877a-f2d39f7ef4a7 req-0ebc57b7-3355-4700-a7f6-f9cb48dc085a service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de62982b-8195-4141-877a-f2d39f7ef4a7 req-0ebc57b7-3355-4700-a7f6-f9cb48dc085a service nova] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de62982b-8195-4141-877a-f2d39f7ef4a7 req-0ebc57b7-3355-4700-a7f6-f9cb48dc085a service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-de62982b-8195-4141-877a-f2d39f7ef4a7 req-0ebc57b7-3355-4700-a7f6-f9cb48dc085a service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-de62982b-8195-4141-877a-f2d39f7ef4a7 req-0ebc57b7-3355-4700-a7f6-f9cb48dc085a service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] No waiting events found dispatching network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:45:28 user nova-compute[72405]: WARNING nova.compute.manager [req-de62982b-8195-4141-877a-f2d39f7ef4a7 req-0ebc57b7-3355-4700-a7f6-f9cb48dc085a service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received unexpected event network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 for instance with vm_state building and task_state spawning.
Aug 08 23:45:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:29 user nova-compute[72405]: INFO nova.compute.manager [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attaching volume 118ef045-427b-4607-bd59-ad1bdd32bf73 to /dev/vdb
Aug 08 23:45:30 user nova-compute[72405]: DEBUG os_brick.utils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbf96f1-df0d-4092-9c6d-7997a86ede7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad98759-dca3-4c3a-966b-e7429ad6ae9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[becdf9a7-326d-4537-a881-a246d3ad2c91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b6d6f8-42ce-451e-8547-9dbec2e74fdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:45:30 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d318163f-d286-4eb0-bc0b-4c3ee8b8e29c]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG os_brick.utils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating existing volume attachment record: 01eef68b-9a9d-4a5d-ac57-d876e4582753 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-0cf13516-ca3a-48b6-bb77-1eabed0b29ef req-e3e7ec62-9d84-426a-8518-ddd63bd3c4dc service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0cf13516-ca3a-48b6-bb77-1eabed0b29ef req-e3e7ec62-9d84-426a-8518-ddd63bd3c4dc service nova] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0cf13516-ca3a-48b6-bb77-1eabed0b29ef req-e3e7ec62-9d84-426a-8518-ddd63bd3c4dc service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0cf13516-ca3a-48b6-bb77-1eabed0b29ef req-e3e7ec62-9d84-426a-8518-ddd63bd3c4dc service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-0cf13516-ca3a-48b6-bb77-1eabed0b29ef req-e3e7ec62-9d84-426a-8518-ddd63bd3c4dc service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] No waiting events found dispatching network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:45:30 user nova-compute[72405]: WARNING nova.compute.manager [req-0cf13516-ca3a-48b6-bb77-1eabed0b29ef req-e3e7ec62-9d84-426a-8518-ddd63bd3c4dc service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received unexpected event network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 for instance with vm_state building and task_state spawning.
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538330.9662678, 200a80f4-ddc2-4197-a0b7-3b25a2e23732 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:45:30 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] VM Resumed (Lifecycle Event)
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:45:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Instance spawned successfully.
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:45:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:45:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:45:31 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:45:31 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538330.9754431, 200a80f4-ddc2-4197-a0b7-3b25a2e23732 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:45:31 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] VM Started (Lifecycle Event)
Aug 08 23:45:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:45:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:45:31 user nova-compute[72405]: INFO nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 08 23:45:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:45:31 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:45:31 user nova-compute[72405]: INFO nova.compute.manager [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Took 19.92 seconds to build instance.
Aug 08 23:45:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b57d4d3a-2b08-43b6-a8e5-59f8e90c4658 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.016s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:39 user nova-compute[72405]: INFO nova.compute.manager [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Terminating instance
Aug 08 23:45:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhvNrUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:45:39 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:45:39 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:45:39 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da2d58-a142-43cb-8455-332ac845e2d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:45:39 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5acf1-ff21-4279-8ceb-8c3c179545c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73] added
Aug 08 23:45:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f924e-1ca5-46a6-a854-1a9be64be824]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a621e6e5-09fd-4787-bc5a-2fb3fdaf235b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYhvNrUb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYhvNrUb" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3876ff75-cb45-4b9e-98c5-f6f3e864cbf6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYhvNrUb'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c432fb4-280f-422f-89e9-c47d27145c7b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c971451-71ed-41b1-a066-296ff05af891]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[625a5546-50ae-42d6-ad33-3627a1768698]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260]
Aug 08 23:45:39 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260] successful.
Aug 08 23:45:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[feedf8de-82e5-4dec-8efe-e291f616cb8e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[139c90ec-1df7-48ea-b3a7-11301eeaf224]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 (non-flash)
Aug 08 23:45:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b49199-8f90-4339-9b46-16c681077872]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhvNrUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-fd500984-b50c-4f28-b688-ac517bb81dd8 req-cb21ccc7-759b-4f6b-a63e-fa42acf78f4f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-vif-unplugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fd500984-b50c-4f28-b688-ac517bb81dd8 req-cb21ccc7-759b-4f6b-a63e-fa42acf78f4f service nova] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fd500984-b50c-4f28-b688-ac517bb81dd8 req-cb21ccc7-759b-4f6b-a63e-fa42acf78f4f service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fd500984-b50c-4f28-b688-ac517bb81dd8 req-cb21ccc7-759b-4f6b-a63e-fa42acf78f4f service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-fd500984-b50c-4f28-b688-ac517bb81dd8 req-cb21ccc7-759b-4f6b-a63e-fa42acf78f4f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] No waiting events found dispatching network-vif-unplugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:45:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-fd500984-b50c-4f28-b688-ac517bb81dd8 req-cb21ccc7-759b-4f6b-a63e-fa42acf78f4f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-vif-unplugged-bfca3a1c-2974-4061-8b49-a9f3695df17f for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Instance destroyed successfully.
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.objects.instance [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lazy-loading 'resources' on Instance uuid 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1646054832',display_name='tempest-ServersNegativeTestJSON-server-1646054832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1646054832',id=33,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e74c497139142c6bb15ba99d7277b8f',ramdisk_id='',reservation_id='r-8e32v67n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1093456984',owner_user_name='tempest-ServersNegativeTestJSON-1093456984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:36:51Z,user_data=None,user_id='fea9b9cda387451ea9e40630216969bb',uuid=44f91b94-b7b6-4c8f-95c4-0bf2d26ca228,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converting VIF {"id": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "address": "fa:16:3e:33:ee:c8", "network": {"id": "8877324a-4c66-4159-b260-d2b461eb57da", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-811921753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e74c497139142c6bb15ba99d7277b8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfca3a1c-29", "ovs_interfaceid": "bfca3a1c-2974-4061-8b49-a9f3695df17f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG os_vif [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfca3a1c-29, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:40 user nova-compute[72405]: INFO os_vif [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ee:c8,bridge_name='br-int',has_traffic_filtering=True,id=bfca3a1c-2974-4061-8b49-a9f3695df17f,network=Network(8877324a-4c66-4159-b260-d2b461eb57da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfca3a1c-29')
Aug 08 23:45:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Deleting instance files /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228_del
Aug 08 23:45:40 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Deletion of /opt/stack/data/nova/instances/44f91b94-b7b6-4c8f-95c4-0bf2d26ca228_del complete
Aug 08 23:45:40 user nova-compute[72405]: INFO nova.compute.manager [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 08 23:45:40 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-33a242e8-a2d0-4ab2-8f80-d62b3da4efeb req-b6ad7c7e-88ee-46f3-b55b-f4e1ca14268f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-vif-deleted-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:40 user nova-compute[72405]: INFO nova.compute.manager [req-33a242e8-a2d0-4ab2-8f80-d62b3da4efeb req-b6ad7c7e-88ee-46f3-b55b-f4e1ca14268f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Neutron deleted interface bfca3a1c-2974-4061-8b49-a9f3695df17f; detaching it from the instance and deleting it from the info cache
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-33a242e8-a2d0-4ab2-8f80-d62b3da4efeb req-b6ad7c7e-88ee-46f3-b55b-f4e1ca14268f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:40 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Took 0.50 seconds to deallocate network for instance.
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-33a242e8-a2d0-4ab2-8f80-d62b3da4efeb req-b6ad7c7e-88ee-46f3-b55b-f4e1ca14268f service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Detach interface failed, port_id=bfca3a1c-2974-4061-8b49-a9f3695df17f, reason: Instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26637306533633164', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637306533633164', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:45:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:45:40 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:45:40 user nova-compute[72405]:   <source dev="/dev/sdc"/>
Aug 08 23:45:40 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:45:40 user nova-compute[72405]:   <serial>118ef045-427b-4607-bd59-ad1bdd32bf73</serial>
Aug 08 23:45:40 user nova-compute[72405]: </disk>
Aug 08 23:45:40 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:41 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Deleted allocations for instance 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228
Aug 08 23:45:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-93e4bd73-57c2-4e97-924d-76cd7dce1dfb tempest-ServersNegativeTestJSON-1093456984 tempest-ServersNegativeTestJSON-1093456984-project-member] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No VIF found with MAC fa:16:3e:1d:c3:fb, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c091bd26-4584-47cd-9862-cf5b1d515cc7 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.667s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-961f29d8-4ad2-4de7-8288-09437dce9b50 req-f42d05fd-4a68-4426-946d-0986c5fa5f89 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received event network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-961f29d8-4ad2-4de7-8288-09437dce9b50 req-f42d05fd-4a68-4426-946d-0986c5fa5f89 service nova] Acquiring lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-961f29d8-4ad2-4de7-8288-09437dce9b50 req-f42d05fd-4a68-4426-946d-0986c5fa5f89 service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-961f29d8-4ad2-4de7-8288-09437dce9b50 req-f42d05fd-4a68-4426-946d-0986c5fa5f89 service nova] Lock "44f91b94-b7b6-4c8f-95c4-0bf2d26ca228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-961f29d8-4ad2-4de7-8288-09437dce9b50 req-f42d05fd-4a68-4426-946d-0986c5fa5f89 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] No waiting events found dispatching network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:45:41 user nova-compute[72405]: WARNING nova.compute.manager [req-961f29d8-4ad2-4de7-8288-09437dce9b50 req-f42d05fd-4a68-4426-946d-0986c5fa5f89 service nova] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Received unexpected event network-vif-plugged-bfca3a1c-2974-4061-8b49-a9f3695df17f for instance with vm_state deleted and task_state None.
Aug 08 23:45:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:45:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:45:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:45:46 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:45:47 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:45:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:45:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:45:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:45:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:45:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:45:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=25.214229583740234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 2e065384-ed86-48da-a709-3d657b017a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6c79afac-4015-4d1b-beb5-ee59d051da3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 200a80f4-ddc2-4197-a0b7-3b25a2e23732 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:45:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:45:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:45:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:45:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:45:55 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538340.0716488, 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:45:55 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] VM Stopped (Lifecycle Event)
Aug 08 23:45:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8227228e-abbc-4330-9030-982212f3774f None None] [instance: 44f91b94-b7b6-4c8f-95c4-0bf2d26ca228] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:45:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:45:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:06 user nova-compute[72405]: INFO nova.compute.manager [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Detaching volume 118ef045-427b-4607-bd59-ad1bdd32bf73
Aug 08 23:46:06 user nova-compute[72405]: INFO nova.virt.block_device [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attempting to driver detach volume 118ef045-427b-4607-bd59-ad1bdd32bf73 from mountpoint /dev/vdb
Aug 08 23:46:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Attempting to detach device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:46:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:46:06 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:46:06 user nova-compute[72405]:   <source dev="/dev/sdc"/>
Aug 08 23:46:06 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:46:06 user nova-compute[72405]:   <serial>118ef045-427b-4607-bd59-ad1bdd32bf73</serial>
Aug 08 23:46:06 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:46:06 user nova-compute[72405]: </disk>
Aug 08 23:46:06 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:46:06 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config.
Aug 08 23:46:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:46:06 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:46:06 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:46:06 user nova-compute[72405]:   <source dev="/dev/sdc"/>
Aug 08 23:46:06 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:46:06 user nova-compute[72405]:   <serial>118ef045-427b-4607-bd59-ad1bdd32bf73</serial>
Aug 08 23:46:06 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:46:06 user nova-compute[72405]: </disk>
Aug 08 23:46:06 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538367.4467273, 482d453c-fbe5-4f41-8454-e290767220ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:46:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config.
Aug 08 23:46:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYhvNrUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:46:07 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c96731c-9e2c-45a8-8166-1f72983cffcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f4309-2506-4898-9403-70a9d709d22f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:46:07 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:46:07 user nova-compute[72405]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 (non-flash)
Aug 08 23:46:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:46:07 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:46:07 user nova-compute[72405]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 (non-flash)
Aug 08 23:46:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb980bd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9fd8a-8812-4d07-83d0-b8111c7325f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7768ffa2-c8ee-4ede-8f15-71e90d26df75]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a44263-7d1a-4fc5-acdc-e76d90d8e9c4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[45445a9d-83d3-4729-9b8c-9d35cbef7085]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[529f46b7-28c3-4e52-bd70-cbf5a2c8e147]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0affae0-c2c7-407a-80f2-ae7047061927]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260]
Aug 08 23:46:07 user nova-compute[72405]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73, portal: 172.16.0.220,3260] successful.
Aug 08 23:46:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:118ef045-427b-4607-bd59-ad1bdd32bf73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a66725-d39e-48a6-908f-da9d0dfaf44b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== disconnect_volume: return (273ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:46:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:46:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:46:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a5f3e601-dafd-4a15-8b7a-4224e6317b22 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.889s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:15 user nova-compute[72405]: INFO nova.compute.manager [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Terminating instance
Aug 08 23:46:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-bca2ee7c-c1d2-4bde-8483-fc777dc9e6d0 req-c545d52b-edd3-4565-8767-2896365ea16b service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-unplugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bca2ee7c-c1d2-4bde-8483-fc777dc9e6d0 req-c545d52b-edd3-4565-8767-2896365ea16b service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bca2ee7c-c1d2-4bde-8483-fc777dc9e6d0 req-c545d52b-edd3-4565-8767-2896365ea16b service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-bca2ee7c-c1d2-4bde-8483-fc777dc9e6d0 req-c545d52b-edd3-4565-8767-2896365ea16b service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-bca2ee7c-c1d2-4bde-8483-fc777dc9e6d0 req-c545d52b-edd3-4565-8767-2896365ea16b service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-unplugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:46:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-bca2ee7c-c1d2-4bde-8483-fc777dc9e6d0 req-c545d52b-edd3-4565-8767-2896365ea16b service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-unplugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:46:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Instance destroyed successfully.
Aug 08 23:46:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'resources' on Instance uuid 2e065384-ed86-48da-a709-3d657b017a79 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432474525',display_name='tempest-TestMinimumBasicScenario-server-1432474525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432474525',id=40,image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgt4050aHARdirQc1Zr73iuQ5SYeoOvZ6Vv7qfr5DKJZItgqJnGwVptVA4SqAnIB5mbi0MOa0U2cnTNpoKRmXzfLvUu/tPy1iSb20aWhUUlCS/nxbnnn1fYj5aZZ73xQ==',key_name='tempest-TestMinimumBasicScenario-1617196526',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-tbgg99tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bc649c0-039a-4752-8e1f-64bc5c95c3ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:43:34Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=2e065384-ed86-48da-a709-3d657b017a79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "address": "fa:16:3e:3e:2c:45", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfc247d1-87", "ovs_interfaceid": "bfc247d1-871f-46d3-9407-1f1ddfe4b5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG os_vif [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfc247d1-87, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:46:16 user nova-compute[72405]: INFO os_vif [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2c:45,bridge_name='br-int',has_traffic_filtering=True,id=bfc247d1-871f-46d3-9407-1f1ddfe4b5e9,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfc247d1-87')
Aug 08 23:46:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Deleting instance files /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79_del
Aug 08 23:46:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Deletion of /opt/stack/data/nova/instances/2e065384-ed86-48da-a709-3d657b017a79_del complete
Aug 08 23:46:16 user nova-compute[72405]: INFO nova.compute.manager [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 08 23:46:16 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:46:16 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:46:17 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:46:17 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Took 0.52 seconds to deallocate network for instance.
Aug 08 23:46:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:17 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:46:17 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:46:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:17 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Deleted allocations for instance 2e065384-ed86-48da-a709-3d657b017a79
Aug 08 23:46:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-b49f14ac-cd64-4a47-a107-408e25319c42 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "2e065384-ed86-48da-a709-3d657b017a79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:46:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] Acquiring lock "2e065384-ed86-48da-a709-3d657b017a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] Lock "2e065384-ed86-48da-a709-3d657b017a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] No waiting events found dispatching network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:46:18 user nova-compute[72405]: WARNING nova.compute.manager [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received unexpected event network-vif-plugged-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 for instance with vm_state deleted and task_state None.
Aug 08 23:46:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-aed717ab-26cf-43fa-b87c-dafd6c1d8d40 req-ea5b9a52-172c-4219-b74b-81d69706ca26 service nova] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Received event network-vif-deleted-bfc247d1-871f-46d3-9407-1f1ddfe4b5e9 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:46:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:46:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:46:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:46:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:46:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:31 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538376.4032412, 2e065384-ed86-48da-a709-3d657b017a79 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:46:31 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 2e065384-ed86-48da-a709-3d657b017a79] VM Stopped (Lifecycle Event)
Aug 08 23:46:31 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e4be1919-dcf8-4a68-89e4-94f862656427 None None] [instance: 2e065384-ed86-48da-a709-3d657b017a79] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:46:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:46:38 user nova-compute[72405]: INFO nova.compute.claims [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Claim successful on node user
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:46:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:46:38 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.policy [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94a805b078b640c29ae13aabfd1fd5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93111863a9dc43b9a50c61a6c1f4c52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:46:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Creating image(s)
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk 1073741824" returned: 0 in 0.054s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Cannot resize image /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'migration_context' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Ensure instance console log exists: /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Successfully created port: d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Successfully updated port: d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG nova.compute.manager [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing instance network info cache due to event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:46:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance network_info: |[{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Start _get_guest_xml network_info=[{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:46:41 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:46:41 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1411537504',display_name='tempest-ServerRescueNegativeTestJSON-server-1411537504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1411537504',id=44,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjtq0R9wy//PGrzT3CMMKz4cOXoiolU4oLvX9Mp/t7B/3mI/kAnGdMQpmpkbjvaJKMt1IXTTdtbpdJz0DnIpZ5gla+qPOVGx+RgCGzgfyhZ8Xh45ie8NWT+Kps1hgoYPA==',key_name='tempest-keypair-1596600579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-wfp2grvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=d46f8020-b843-442b-b6f9-709536a8d419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'pci_devices' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:46:41 user nova-compute[72405]:   <uuid>d46f8020-b843-442b-b6f9-709536a8d419</uuid>
Aug 08 23:46:41 user nova-compute[72405]:   <name>instance-0000002c</name>
Aug 08 23:46:41 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:46:41 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:46:41 user nova-compute[72405]:   <metadata>
Aug 08 23:46:41 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:46:41 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:46:41 user nova-compute[72405]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1411537504</nova:name>
Aug 08 23:46:41 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:46:41</nova:creationTime>
Aug 08 23:46:41 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:46:41 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:46:41 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:46:41 user nova-compute[72405]:       <nova:owner>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:user uuid="94a805b078b640c29ae13aabfd1fd5a5">tempest-ServerRescueNegativeTestJSON-297666519-project-member</nova:user>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:project uuid="93111863a9dc43b9a50c61a6c1f4c52c">tempest-ServerRescueNegativeTestJSON-297666519</nova:project>
Aug 08 23:46:41 user nova-compute[72405]:       </nova:owner>
Aug 08 23:46:41 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:46:41 user nova-compute[72405]:       <nova:ports>
Aug 08 23:46:41 user nova-compute[72405]:         <nova:port uuid="d3da762d-06c5-455d-bd9e-ae602fdd4c0c">
Aug 08 23:46:41 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 08 23:46:41 user nova-compute[72405]:         </nova:port>
Aug 08 23:46:41 user nova-compute[72405]:       </nova:ports>
Aug 08 23:46:41 user nova-compute[72405]:     </nova:instance>
Aug 08 23:46:41 user nova-compute[72405]:   </metadata>
Aug 08 23:46:41 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:46:41 user nova-compute[72405]:     <system>
Aug 08 23:46:41 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:46:41 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:46:41 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:46:41 user nova-compute[72405]:       <entry name="serial">d46f8020-b843-442b-b6f9-709536a8d419</entry>
Aug 08 23:46:41 user nova-compute[72405]:       <entry name="uuid">d46f8020-b843-442b-b6f9-709536a8d419</entry>
Aug 08 23:46:41 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:46:41 user nova-compute[72405]:     </system>
Aug 08 23:46:41 user nova-compute[72405]:   </sysinfo>
Aug 08 23:46:41 user nova-compute[72405]:   <os>
Aug 08 23:46:41 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:46:41 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:46:41 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:46:41 user nova-compute[72405]:   </os>
Aug 08 23:46:41 user nova-compute[72405]:   <features>
Aug 08 23:46:41 user nova-compute[72405]:     <acpi/>
Aug 08 23:46:41 user nova-compute[72405]:     <apic/>
Aug 08 23:46:41 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:46:41 user nova-compute[72405]:   </features>
Aug 08 23:46:41 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:46:41 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:46:41 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:46:41 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:46:41 user nova-compute[72405]:   </clock>
Aug 08 23:46:41 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:46:41 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:46:41 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:46:41 user nova-compute[72405]:   </cpu>
Aug 08 23:46:41 user nova-compute[72405]:   <devices>
Aug 08 23:46:41 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:46:41 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:46:41 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk"/>
Aug 08 23:46:41 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:46:41 user nova-compute[72405]:     </disk>
Aug 08 23:46:41 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:46:41 user nova-compute[72405]:       <mac address="fa:16:3e:d1:5d:44"/>
Aug 08 23:46:41 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:46:41 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:46:41 user nova-compute[72405]:       <target dev="tapd3da762d-06"/>
Aug 08 23:46:41 user nova-compute[72405]:     </interface>
Aug 08 23:46:41 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:46:41 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/console.log" append="off"/>
Aug 08 23:46:41 user nova-compute[72405]:     </serial>
Aug 08 23:46:41 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:46:41 user nova-compute[72405]:     <video>
Aug 08 23:46:41 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:46:41 user nova-compute[72405]:     </video>
Aug 08 23:46:41 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:46:41 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:46:41 user nova-compute[72405]:     </rng>
Aug 08 23:46:41 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:46:41 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:46:41 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:46:41 user nova-compute[72405]:     </memballoon>
Aug 08 23:46:41 user nova-compute[72405]:   </devices>
Aug 08 23:46:41 user nova-compute[72405]: </domain>
Aug 08 23:46:41 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1411537504',display_name='tempest-ServerRescueNegativeTestJSON-server-1411537504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1411537504',id=44,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjtq0R9wy//PGrzT3CMMKz4cOXoiolU4oLvX9Mp/t7B/3mI/kAnGdMQpmpkbjvaJKMt1IXTTdtbpdJz0DnIpZ5gla+qPOVGx+RgCGzgfyhZ8Xh45ie8NWT+Kps1hgoYPA==',key_name='tempest-keypair-1596600579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-wfp2grvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=d46f8020-b843-442b-b6f9-709536a8d419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG os_vif [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3da762d-06, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3da762d-06, col_values=(('external_ids', {'iface-id': 'd3da762d-06c5-455d-bd9e-ae602fdd4c0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:5d:44', 'vm-uuid': 'd46f8020-b843-442b-b6f9-709536a8d419'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:46:41 user nova-compute[72405]: INFO os_vif [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06')
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:d1:5d:44, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updated VIF entry in instance network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG nova.network.neutron [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:46:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9355e64d-d011-4401-a000-cb831de67d5d req-ba8f2bf0-41dc-481e-b446-ca4edd6a410c service nova] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:46:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-39167c6e-59a3-4c5e-b8b2-b75da61616bf req-15d18766-52e3-4497-9c31-16e0af3b5b1f service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:46:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-39167c6e-59a3-4c5e-b8b2-b75da61616bf req-15d18766-52e3-4497-9c31-16e0af3b5b1f service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-39167c6e-59a3-4c5e-b8b2-b75da61616bf req-15d18766-52e3-4497-9c31-16e0af3b5b1f service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-39167c6e-59a3-4c5e-b8b2-b75da61616bf req-15d18766-52e3-4497-9c31-16e0af3b5b1f service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-39167c6e-59a3-4c5e-b8b2-b75da61616bf req-15d18766-52e3-4497-9c31-16e0af3b5b1f service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:46:43 user nova-compute[72405]: WARNING nova.compute.manager [req-39167c6e-59a3-4c5e-b8b2-b75da61616bf req-15d18766-52e3-4497-9c31-16e0af3b5b1f service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state building and task_state spawning.
Aug 08 23:46:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:44 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538404.9691815, d46f8020-b843-442b-b6f9-709536a8d419 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:46:44 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Resumed (Lifecycle Event)
Aug 08 23:46:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:46:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:46:44 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance spawned successfully.
Aug 08 23:46:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:46:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:46:45 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538404.9712336, d46f8020-b843-442b-b6f9-709536a8d419 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:46:45 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Started (Lifecycle Event)
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:46:45 user nova-compute[72405]: INFO nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:46:45 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:46:45 user nova-compute[72405]: INFO nova.compute.manager [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Took 6.89 seconds to build instance.
Aug 08 23:46:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-9c269f9b-642b-40b5-a458-695cfa0f4deb tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.015s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-dd4241b5-3f12-4c69-a1f6-ff6b617c982a req-ddb25d2d-09b9-4250-8636-be5eb1b9a000 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dd4241b5-3f12-4c69-a1f6-ff6b617c982a req-ddb25d2d-09b9-4250-8636-be5eb1b9a000 service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dd4241b5-3f12-4c69-a1f6-ff6b617c982a req-ddb25d2d-09b9-4250-8636-be5eb1b9a000 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-dd4241b5-3f12-4c69-a1f6-ff6b617c982a req-ddb25d2d-09b9-4250-8636-be5eb1b9a000 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-dd4241b5-3f12-4c69-a1f6-ff6b617c982a req-ddb25d2d-09b9-4250-8636-be5eb1b9a000 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:46:45 user nova-compute[72405]: WARNING nova.compute.manager [req-dd4241b5-3f12-4c69-a1f6-ff6b617c982a req-ddb25d2d-09b9-4250-8636-be5eb1b9a000 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state active and task_state None.
Aug 08 23:46:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:46:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 08 23:46:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:46:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:46:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.229198455810547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6c79afac-4015-4d1b-beb5-ee59d051da3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 200a80f4-ddc2-4197-a0b7-3b25a2e23732 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:46:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:46:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:46:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:46:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:46:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:46:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:46:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:46:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:00 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:01 user nova-compute[72405]: INFO nova.compute.manager [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attaching volume 96bdab8e-4099-4462-8126-15164a02c1ed to /dev/vdb
Aug 08 23:47:01 user nova-compute[72405]: DEBUG os_brick.utils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d411a6-fd20-4c6f-ac49-b2ae3929919a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870c947-2259-49c3-a7fd-cccbdacea5ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d638bdbf-aaa9-4ba3-9d36-45facc72c787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0143da72-ccc7-47d4-b22e-126cf2125210]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:47:01 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:47:01 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[208957c8-1002-4b4b-9dbf-938e878dfeb9]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG os_brick.utils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating existing volume attachment record: c0d07e25-6412-4ab3-bb82-16e7a3062687 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:47:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-changed-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:02 user nova-compute[72405]: DEBUG nova.compute.manager [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Refreshing instance network info cache due to event network-changed-232ed00a-f332-444d-99c7-09243be845d4. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:47:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] Acquiring lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:47:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] Acquired lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:47:02 user nova-compute[72405]: DEBUG nova.network.neutron [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Refreshing network info cache for port 232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:47:03 user nova-compute[72405]: DEBUG nova.network.neutron [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updated VIF entry in instance network info cache for port 232ed00a-f332-444d-99c7-09243be845d4. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:47:03 user nova-compute[72405]: DEBUG nova.network.neutron [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updating instance_info_cache with network_info: [{"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:47:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f2de810-c367-4df5-a19a-de661925e5f4 req-74e2b089-ad40-435f-bf80-20610f958161 service nova] Releasing lock "refresh_cache-200a80f4-ddc2-4197-a0b7-3b25a2e23732" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:04 user nova-compute[72405]: INFO nova.compute.manager [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Terminating instance
Aug 08 23:47:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-058b6144-125c-415a-b523-937b3dfce2a2 req-66f32455-9458-4993-8cd5-8d2cac3dc1fe service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-vif-unplugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-058b6144-125c-415a-b523-937b3dfce2a2 req-66f32455-9458-4993-8cd5-8d2cac3dc1fe service nova] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-058b6144-125c-415a-b523-937b3dfce2a2 req-66f32455-9458-4993-8cd5-8d2cac3dc1fe service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-058b6144-125c-415a-b523-937b3dfce2a2 req-66f32455-9458-4993-8cd5-8d2cac3dc1fe service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-058b6144-125c-415a-b523-937b3dfce2a2 req-66f32455-9458-4993-8cd5-8d2cac3dc1fe service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] No waiting events found dispatching network-vif-unplugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:47:04 user nova-compute[72405]: DEBUG nova.compute.manager [req-058b6144-125c-415a-b523-937b3dfce2a2 req-66f32455-9458-4993-8cd5-8d2cac3dc1fe service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-vif-unplugged-232ed00a-f332-444d-99c7-09243be845d4 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:47:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Instance destroyed successfully.
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'resources' on Instance uuid 200a80f4-ddc2-4197-a0b7-3b25a2e23732 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-114076471',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-114076471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-114076471',id=43,image_ref='69d377a2-8cbc-48b8-8299-4371a5815b18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJWGGtq1yXgoutt+5gUjmdrr77WUjk669rUro22YnnBCasViwP3VA0phpExkWmbGa3foZ9s2ayoSmebd/uHYmwwQm7jrroolsjjV7b6dzzn6XubvHI8uW68AcWgCckOjw==',key_name='tempest-keypair-1853198850',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:45:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-at5kdup3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1873778230',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:45:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246e22061eb47eda51b4b6634102922',uuid=200a80f4-ddc2-4197-a0b7-3b25a2e23732,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "232ed00a-f332-444d-99c7-09243be845d4", "address": "fa:16:3e:9b:03:0d", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap232ed00a-f3", "ovs_interfaceid": "232ed00a-f332-444d-99c7-09243be845d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_vif [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap232ed00a-f3, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:47:05 user nova-compute[72405]: INFO os_vif [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:0d,bridge_name='br-int',has_traffic_filtering=True,id=232ed00a-f332-444d-99c7-09243be845d4,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232ed00a-f3')
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpycNDnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:47:05 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe16b23-fe71-4b48-be0b-7448e2985008]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[616fb7eb-0985-4382-8f83-e9cca14bfc6b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:05 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:47:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:05 user nova-compute[72405]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 (non-flash)
Aug 08 23:47:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54ec6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d7487-aa0e-4234-ae45-5beb8c418613]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5037c8e2-57e7-47d0-8184-e88004024531]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9c4557-9887-45c4-8147-906e2736d4f5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8ea82-7eaf-4947-909d-91ffcbc63e9a]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdf88a66e-f2da7ee131b27750', '/dev/disk/by-id/scsi-26632646137656531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_df88a66e') {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4cb33c-2f91-45e4-b57b-0a65d428ceb0]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63385e4-71e5-4402-bd9b-d7bd1bd2b1f0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4404a1-a52f-40f2-82e7-8c66cf840fc7]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260]
Aug 08 23:47:05 user nova-compute[72405]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76, portal: 172.16.0.220,3260] successful.
Aug 08 23:47:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a972cfc3-f524-420b-99df-1d82ff635e76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd16c7-8a68-4f94-88a3-598367e2eeb1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== disconnect_volume: return (326ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:47:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Deleting instance files /opt/stack/data/nova/instances/200a80f4-ddc2-4197-a0b7-3b25a2e23732_del
Aug 08 23:47:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Deletion of /opt/stack/data/nova/instances/200a80f4-ddc2-4197-a0b7-3b25a2e23732_del complete
Aug 08 23:47:05 user nova-compute[72405]: INFO nova.compute.manager [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 08 23:47:05 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:47:05 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:47:06 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:47:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-c1e579a4-8c1f-47dc-8d0d-813f7f7763a0 req-0a8d72b6-c979-416c-afda-8e1737e7fafb service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-vif-deleted-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:06 user nova-compute[72405]: INFO nova.compute.manager [req-c1e579a4-8c1f-47dc-8d0d-813f7f7763a0 req-0a8d72b6-c979-416c-afda-8e1737e7fafb service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Neutron deleted interface 232ed00a-f332-444d-99c7-09243be845d4; detaching it from the instance and deleting it from the info cache
Aug 08 23:47:06 user nova-compute[72405]: DEBUG nova.network.neutron [req-c1e579a4-8c1f-47dc-8d0d-813f7f7763a0 req-0a8d72b6-c979-416c-afda-8e1737e7fafb service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:47:06 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Took 1.07 seconds to deallocate network for instance.
Aug 08 23:47:06 user nova-compute[72405]: DEBUG nova.compute.manager [req-c1e579a4-8c1f-47dc-8d0d-813f7f7763a0 req-0a8d72b6-c979-416c-afda-8e1737e7fafb service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Detach interface failed, port_id=232ed00a-f332-444d-99c7-09243be845d4, reason: Instance 200a80f4-ddc2-4197-a0b7-3b25a2e23732 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-0c3e451c-4cbe-4854-9c42-7e847d028e24 req-103f4a31-069e-4044-87a0-6bf876768d7b service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received event network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0c3e451c-4cbe-4854-9c42-7e847d028e24 req-103f4a31-069e-4044-87a0-6bf876768d7b service nova] Acquiring lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0c3e451c-4cbe-4854-9c42-7e847d028e24 req-103f4a31-069e-4044-87a0-6bf876768d7b service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0c3e451c-4cbe-4854-9c42-7e847d028e24 req-103f4a31-069e-4044-87a0-6bf876768d7b service nova] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-0c3e451c-4cbe-4854-9c42-7e847d028e24 req-103f4a31-069e-4044-87a0-6bf876768d7b service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] No waiting events found dispatching network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:47:07 user nova-compute[72405]: WARNING nova.compute.manager [req-0c3e451c-4cbe-4854-9c42-7e847d028e24 req-103f4a31-069e-4044-87a0-6bf876768d7b service nova] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Received unexpected event network-vif-plugged-232ed00a-f332-444d-99c7-09243be845d4 for instance with vm_state active and task_state deleting.
Aug 08 23:47:07 user nova-compute[72405]: INFO nova.compute.manager [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Took 0.81 seconds to detach 1 volumes for instance.
Aug 08 23:47:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Deleting volume: a972cfc3-f524-420b-99df-1d82ff635e76 {{(pid=72405) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:47:07 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:47:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:08 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Deleted allocations for instance 200a80f4-ddc2-4197-a0b7-3b25a2e23732
Aug 08 23:47:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-dcf6415f-4e00-48ef-a651-a4336d4aec7b tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "200a80f4-ddc2-4197-a0b7-3b25a2e23732" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.751s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plFhJbHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:47:09 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:47:09 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:47:09 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[871b9fce-8273-4110-b30e-d73f7d47f5a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:47:09 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c6ed6-1950-46eb-ab6a-8a6f56ebd7f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed] added
Aug 08 23:47:09 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7ad7ed-1a9f-4b5c-8c89-72a229631bf7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bd83bf-aed6-4855-bd19-0caa6921999d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v plFhJbHR {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v plFhJbHR" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c072ec-6fc9-4ff8-a528-59ba3401057a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'plFhJbHR'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b8ae1-a421-46ae-a421-1d05d2ea399a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded5888-b215-4984-b0ca-98d8a2cd99a5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feeef45-a916-4a58-ac66-197a9f2bfe5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260]
Aug 08 23:47:10 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260] successful.
Aug 08 23:47:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb1b112-df3b-4387-8e9a-c70b64124e9a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd759d-c81a-48b4-bfb2-b8cf82b2eef9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:10 user nova-compute[72405]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed (non-flash)
Aug 08 23:47:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:10 user nova-compute[72405]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed (non-flash)
Aug 08 23:47:10 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaad022f-e676-4ffe-9d40-54cf313aa85c]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plFhJbHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:47:10 user nova-compute[72405]: INFO nova.compute.claims [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Claim successful on node user
Aug 08 23:47:10 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:47:10 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '26230303339336132', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303339336132', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:47:11 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:47:11 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:47:11 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:47:11 user nova-compute[72405]:   <serial>96bdab8e-4099-4462-8126-15164a02c1ed</serial>
Aug 08 23:47:11 user nova-compute[72405]: </disk>
Aug 08 23:47:11 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:47:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.policy [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13ba98961cad44b0a1246d7d7aaf1e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2fb572f9cd475e91d08e349f2b1320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:47:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Creating image(s)
Aug 08 23:47:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "/opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "/opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "/opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "3573230327a96d20d143387e1a542db074d9f8b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "3573230327a96d20d143387e1a542db074d9f8b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No VIF found with MAC fa:16:3e:1d:c3:fb, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG nova.virt.images [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] 976795a8-ee84-4937-bc5c-3653607c32ac was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.part /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bf065d4a-ac11-4e58-a527-90dd10511417 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.130s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Successfully created port: 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.part /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.converted" returned: 0 in 0.422s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "3573230327a96d20d143387e1a542db074d9f8b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.258s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "3573230327a96d20d143387e1a542db074d9f8b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "3573230327a96d20d143387e1a542db074d9f8b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 --force-share --output=json" returned: 0 in 0.159s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9,backing_fmt=raw /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9,backing_fmt=raw /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk 1073741824" returned: 0 in 0.058s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "3573230327a96d20d143387e1a542db074d9f8b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Successfully updated port: 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing instance network info cache due to event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Cannot resize image /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'migration_context' on Instance uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Ensure instance console log exists: /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance network_info: |[{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.neutron [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Start _get_guest_xml network_info=[{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:47:07Z,direct_url=<?>,disk_format='qcow2',id=976795a8-ee84-4937-bc5c-3653607c32ac,min_disk=0,min_ram=0,name='tempest-scenario-img--385252023',owner='dd2fb572f9cd475e91d08e349f2b1320',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:47:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': '976795a8-ee84-4937-bc5c-3653607c32ac'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:47:13 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:47:13 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:47:07Z,direct_url=<?>,disk_format='qcow2',id=976795a8-ee84-4937-bc5c-3653607c32ac,min_disk=0,min_ram=0,name='tempest-scenario-img--385252023',owner='dd2fb572f9cd475e91d08e349f2b1320',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:47:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1804512516',display_name='tempest-TestMinimumBasicScenario-server-1804512516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1804512516',id=45,image_ref='976795a8-ee84-4937-bc5c-3653607c32ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2UAG5yelSLvIfS59350v1RSArQdSW7tPkN626uaJT2OBFFEjLXLm2SYZURQMuMk9tI3WPGfTmlQILFxkehPj53baXkFJ/ADqHiAzd47bk+IeU40KfsCUOZtkqb7tqt8w==',key_name='tempest-TestMinimumBasicScenario-1136501143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-ztu44t86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='976795a8-ee84-4937-bc5c-3653607c32ac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:47:11Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=5585ea20-9eb7-47c3-8b03-4c8253a7864f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'pci_devices' on Instance uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:47:13 user nova-compute[72405]:   <uuid>5585ea20-9eb7-47c3-8b03-4c8253a7864f</uuid>
Aug 08 23:47:13 user nova-compute[72405]:   <name>instance-0000002d</name>
Aug 08 23:47:13 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:47:13 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:47:13 user nova-compute[72405]:   <metadata>
Aug 08 23:47:13 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:47:13 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:47:13 user nova-compute[72405]:       <nova:name>tempest-TestMinimumBasicScenario-server-1804512516</nova:name>
Aug 08 23:47:13 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:47:13</nova:creationTime>
Aug 08 23:47:13 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:47:13 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:47:13 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:47:13 user nova-compute[72405]:       <nova:owner>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:user uuid="13ba98961cad44b0a1246d7d7aaf1e9a">tempest-TestMinimumBasicScenario-511149043-project-member</nova:user>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:project uuid="dd2fb572f9cd475e91d08e349f2b1320">tempest-TestMinimumBasicScenario-511149043</nova:project>
Aug 08 23:47:13 user nova-compute[72405]:       </nova:owner>
Aug 08 23:47:13 user nova-compute[72405]:       <nova:root type="image" uuid="976795a8-ee84-4937-bc5c-3653607c32ac"/>
Aug 08 23:47:13 user nova-compute[72405]:       <nova:ports>
Aug 08 23:47:13 user nova-compute[72405]:         <nova:port uuid="3cdd8eee-7983-4b19-be19-4b3cd582c137">
Aug 08 23:47:13 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 08 23:47:13 user nova-compute[72405]:         </nova:port>
Aug 08 23:47:13 user nova-compute[72405]:       </nova:ports>
Aug 08 23:47:13 user nova-compute[72405]:     </nova:instance>
Aug 08 23:47:13 user nova-compute[72405]:   </metadata>
Aug 08 23:47:13 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:47:13 user nova-compute[72405]:     <system>
Aug 08 23:47:13 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:47:13 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:47:13 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:47:13 user nova-compute[72405]:       <entry name="serial">5585ea20-9eb7-47c3-8b03-4c8253a7864f</entry>
Aug 08 23:47:13 user nova-compute[72405]:       <entry name="uuid">5585ea20-9eb7-47c3-8b03-4c8253a7864f</entry>
Aug 08 23:47:13 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:47:13 user nova-compute[72405]:     </system>
Aug 08 23:47:13 user nova-compute[72405]:   </sysinfo>
Aug 08 23:47:13 user nova-compute[72405]:   <os>
Aug 08 23:47:13 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:47:13 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:47:13 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:47:13 user nova-compute[72405]:   </os>
Aug 08 23:47:13 user nova-compute[72405]:   <features>
Aug 08 23:47:13 user nova-compute[72405]:     <acpi/>
Aug 08 23:47:13 user nova-compute[72405]:     <apic/>
Aug 08 23:47:13 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:47:13 user nova-compute[72405]:   </features>
Aug 08 23:47:13 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:47:13 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:47:13 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:47:13 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:47:13 user nova-compute[72405]:   </clock>
Aug 08 23:47:13 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:47:13 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:47:13 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:47:13 user nova-compute[72405]:   </cpu>
Aug 08 23:47:13 user nova-compute[72405]:   <devices>
Aug 08 23:47:13 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:47:13 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:47:13 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk"/>
Aug 08 23:47:13 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:47:13 user nova-compute[72405]:     </disk>
Aug 08 23:47:13 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:47:13 user nova-compute[72405]:       <mac address="fa:16:3e:7b:d7:11"/>
Aug 08 23:47:13 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:47:13 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:47:13 user nova-compute[72405]:       <target dev="tap3cdd8eee-79"/>
Aug 08 23:47:13 user nova-compute[72405]:     </interface>
Aug 08 23:47:13 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:47:13 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/console.log" append="off"/>
Aug 08 23:47:13 user nova-compute[72405]:     </serial>
Aug 08 23:47:13 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:47:13 user nova-compute[72405]:     <video>
Aug 08 23:47:13 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:47:13 user nova-compute[72405]:     </video>
Aug 08 23:47:13 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:47:13 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:47:13 user nova-compute[72405]:     </rng>
Aug 08 23:47:13 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:47:13 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:47:13 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:47:13 user nova-compute[72405]:     </memballoon>
Aug 08 23:47:13 user nova-compute[72405]:   </devices>
Aug 08 23:47:13 user nova-compute[72405]: </domain>
Aug 08 23:47:13 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1804512516',display_name='tempest-TestMinimumBasicScenario-server-1804512516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1804512516',id=45,image_ref='976795a8-ee84-4937-bc5c-3653607c32ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2UAG5yelSLvIfS59350v1RSArQdSW7tPkN626uaJT2OBFFEjLXLm2SYZURQMuMk9tI3WPGfTmlQILFxkehPj53baXkFJ/ADqHiAzd47bk+IeU40KfsCUOZtkqb7tqt8w==',key_name='tempest-TestMinimumBasicScenario-1136501143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-ztu44t86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='976795a8-ee84-4937-bc5c-3653607c32ac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:47:11Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=5585ea20-9eb7-47c3-8b03-4c8253a7864f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG os_vif [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cdd8eee-79, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cdd8eee-79, col_values=(('external_ids', {'iface-id': '3cdd8eee-7983-4b19-be19-4b3cd582c137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:d7:11', 'vm-uuid': '5585ea20-9eb7-47c3-8b03-4c8253a7864f'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:47:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:13 user nova-compute[72405]: INFO os_vif [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79')
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No VIF found with MAC fa:16:3e:7b:d7:11, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updated VIF entry in instance network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.network.neutron [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1bedbdf7-6689-4641-828a-d493ed77e915 req-1d166130-145e-4c19-81b6-36b2acecb1a2 service nova] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:14 user nova-compute[72405]: INFO nova.compute.manager [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Detaching volume 96bdab8e-4099-4462-8126-15164a02c1ed
Aug 08 23:47:14 user nova-compute[72405]: INFO nova.virt.block_device [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attempting to driver detach volume 96bdab8e-4099-4462-8126-15164a02c1ed from mountpoint /dev/vdb
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Attempting to detach device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:47:14 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:47:14 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:47:14 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:47:14 user nova-compute[72405]:   <serial>96bdab8e-4099-4462-8126-15164a02c1ed</serial>
Aug 08 23:47:14 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:47:14 user nova-compute[72405]: </disk>
Aug 08 23:47:14 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:47:14 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config.
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:47:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:47:14 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:47:14 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:47:14 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:47:14 user nova-compute[72405]:   <serial>96bdab8e-4099-4462-8126-15164a02c1ed</serial>
Aug 08 23:47:14 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:47:14 user nova-compute[72405]: </disk>
Aug 08 23:47:14 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538435.5727055, 482d453c-fbe5-4f41-8454-e290767220ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:47:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config.
Aug 08 23:47:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plFhJbHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:47:15 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-6234ed20-e486-4957-b789-2fb6a129e085 req-3bb7a002-3815-40a0-80f7-f3a2acf95b49 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6234ed20-e486-4957-b789-2fb6a129e085 req-3bb7a002-3815-40a0-80f7-f3a2acf95b49 service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6234ed20-e486-4957-b789-2fb6a129e085 req-3bb7a002-3815-40a0-80f7-f3a2acf95b49 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-6234ed20-e486-4957-b789-2fb6a129e085 req-3bb7a002-3815-40a0-80f7-f3a2acf95b49 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-6234ed20-e486-4957-b789-2fb6a129e085 req-3bb7a002-3815-40a0-80f7-f3a2acf95b49 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:47:15 user nova-compute[72405]: WARNING nova.compute.manager [req-6234ed20-e486-4957-b789-2fb6a129e085 req-3bb7a002-3815-40a0-80f7-f3a2acf95b49 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state building and task_state spawning.
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d11419-0628-42c7-b99c-4668db569480]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[033e0907-0a34-446a-b02b-1b3264079ae5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:15 user nova-compute[72405]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed (non-flash)
Aug 08 23:47:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:47:15 user nova-compute[72405]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed (non-flash)
Aug 08 23:47:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f1a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead907c3-ca16-4636-bb71-27f490927977]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f30160-d55b-4cdf-9155-12e7cf024680]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfd8e1-577e-4a63-a310-d4e90ab24f87]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6c2670-4a5a-4826-972b-a0f53b862505]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b3775-9f76-4411-abb5-cbc9c1e05993]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96bef9d-4792-4365-a7ba-10b8f31a215d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260]
Aug 08 23:47:15 user nova-compute[72405]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed, portal: 172.16.0.220,3260] successful.
Aug 08 23:47:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96bdab8e-4099-4462-8126-15164a02c1ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc41a19-6262-42d4-bd74-b8a0a9457bd8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== disconnect_volume: return (296ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:47:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5912df02-2a30-4a28-8a9d-e6eab6613bad tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.898s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-36264fdf-b953-4dbc-ba33-a3b1d1d0177a req-b6be2162-d4ba-407e-8070-89c2abfabe43 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-36264fdf-b953-4dbc-ba33-a3b1d1d0177a req-b6be2162-d4ba-407e-8070-89c2abfabe43 service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-36264fdf-b953-4dbc-ba33-a3b1d1d0177a req-b6be2162-d4ba-407e-8070-89c2abfabe43 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-36264fdf-b953-4dbc-ba33-a3b1d1d0177a req-b6be2162-d4ba-407e-8070-89c2abfabe43 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [req-36264fdf-b953-4dbc-ba33-a3b1d1d0177a req-b6be2162-d4ba-407e-8070-89c2abfabe43 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:47:17 user nova-compute[72405]: WARNING nova.compute.manager [req-36264fdf-b953-4dbc-ba33-a3b1d1d0177a req-b6be2162-d4ba-407e-8070-89c2abfabe43 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state building and task_state spawning.
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538437.7310474, 5585ea20-9eb7-47c3-8b03-4c8253a7864f => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] VM Resumed (Lifecycle Event)
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance spawned successfully.
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538437.7329044, 5585ea20-9eb7-47c3-8b03-4c8253a7864f => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] VM Started (Lifecycle Event)
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 08 23:47:17 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:47:17 user nova-compute[72405]: INFO nova.compute.manager [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Took 7.31 seconds to build instance.
Aug 08 23:47:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e856b729-905a-4ecc-ba40-49004d8eb689 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.437s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:20 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538425.2150307, 200a80f4-ddc2-4197-a0b7-3b25a2e23732 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:47:20 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] VM Stopped (Lifecycle Event)
Aug 08 23:47:20 user nova-compute[72405]: DEBUG nova.compute.manager [None req-9525f1bd-439a-4ac8-9f8d-622a40d94d64 None None] [instance: 200a80f4-ddc2-4197-a0b7-3b25a2e23732] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:47:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:47:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:47:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:47:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:47:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:47:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:47:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:47:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:47:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:47:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:47:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:47:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:47:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:47:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:49 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:47:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:47:51 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=25.140850067138672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 6c79afac-4015-4d1b-beb5-ee59d051da3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:47:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:47:52 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:47:52 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:47:52 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:47:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:47:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:47:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:59 user nova-compute[72405]: INFO nova.compute.manager [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Terminating instance
Aug 08 23:47:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-25d39e96-30a3-404c-9529-c07356dbb71a req-0e57ff30-458c-40eb-a019-97db74b97ba3 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-vif-unplugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-25d39e96-30a3-404c-9529-c07356dbb71a req-0e57ff30-458c-40eb-a019-97db74b97ba3 service nova] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-25d39e96-30a3-404c-9529-c07356dbb71a req-0e57ff30-458c-40eb-a019-97db74b97ba3 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-25d39e96-30a3-404c-9529-c07356dbb71a req-0e57ff30-458c-40eb-a019-97db74b97ba3 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-25d39e96-30a3-404c-9529-c07356dbb71a req-0e57ff30-458c-40eb-a019-97db74b97ba3 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] No waiting events found dispatching network-vif-unplugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:47:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-25d39e96-30a3-404c-9529-c07356dbb71a req-0e57ff30-458c-40eb-a019-97db74b97ba3 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-vif-unplugged-c8837325-2bb8-4285-b48a-d5290f36d105 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Instance destroyed successfully.
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.objects.instance [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'resources' on Instance uuid 6c79afac-4015-4d1b-beb5-ee59d051da3c {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-989545255',display_name='tempest-TestVolumeBootPattern-volume-backed-server-989545255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-989545255',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvXVOGVXF4felhnV1SHfgOVwnMWA6E80FIaviOwjEOOBCRv+KBW+7MNtmKk0ltP4o7PKQr4AdnJESqVmUgWOwmfMFieHjeuiRNZc1V4wwrOpAN2QPiYEO6nnTduR650pg==',key_name='tempest-keypair-458617660',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:43:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-vh473jfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246e22061eb47eda51b4b6634102922',uuid=6c79afac-4015-4d1b-beb5-ee59d051da3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "c8837325-2bb8-4285-b48a-d5290f36d105", "address": "fa:16:3e:2f:e2:32", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8837325-2b", "ovs_interfaceid": "c8837325-2bb8-4285-b48a-d5290f36d105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_vif [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8837325-2b, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:48:00 user nova-compute[72405]: INFO os_vif [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e2:32,bridge_name='br-int',has_traffic_filtering=True,id=c8837325-2bb8-4285-b48a-d5290f36d105,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8837325-2b')
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXmBaCYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:48:00 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9b520-19f0-49a9-9ff5-17db8f865b83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa65558e-5dc5-4121-950b-347d43aaddbc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:48:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 (non-flash)
Aug 08 23:48:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f19ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f1f00-f923-4e82-a9e9-89855f53d0a9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fc415a-9827-4607-8bc6-2861a2352d8f]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f2d0df-41ed-4340-9730-1400a8bd82eb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e0fac0-74a7-479f-8595-8c79917cc7cf]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8d91fb11-19f488db6ccdb559', '/dev/disk/by-id/scsi-23139663438386462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8d91fb11') {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9db831-0e78-4f65-a1f1-e7d257d242a8]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2768610a-4cf3-4b29-a278-98bb195719a9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.163s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8391471-e03b-480f-b68e-3ead2fe7a45c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260]
Aug 08 23:48:00 user nova-compute[72405]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6, portal: 172.16.0.220,3260] successful.
Aug 08 23:48:00 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:104ea5aa-8da3-4871-afd2-c3f8afdb87d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125af1b-0559-4b6f-a98c-6310322f1e22]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== disconnect_volume: return (411ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:48:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Deleting instance files /opt/stack/data/nova/instances/6c79afac-4015-4d1b-beb5-ee59d051da3c_del
Aug 08 23:48:00 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Deletion of /opt/stack/data/nova/instances/6c79afac-4015-4d1b-beb5-ee59d051da3c_del complete
Aug 08 23:48:00 user nova-compute[72405]: INFO nova.compute.manager [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 08 23:48:00 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:48:01 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Took 0.96 seconds to deallocate network for instance.
Aug 08 23:48:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-7fe65782-ac8f-4988-a3ee-5ce51e66f6df req-23a43f37-7275-4c16-a1a8-527af4e134e6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-vif-deleted-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:01 user nova-compute[72405]: INFO nova.compute.manager [req-7fe65782-ac8f-4988-a3ee-5ce51e66f6df req-23a43f37-7275-4c16-a1a8-527af4e134e6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Neutron deleted interface c8837325-2bb8-4285-b48a-d5290f36d105; detaching it from the instance and deleting it from the info cache
Aug 08 23:48:01 user nova-compute[72405]: DEBUG nova.network.neutron [req-7fe65782-ac8f-4988-a3ee-5ce51e66f6df req-23a43f37-7275-4c16-a1a8-527af4e134e6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-7fe65782-ac8f-4988-a3ee-5ce51e66f6df req-23a43f37-7275-4c16-a1a8-527af4e134e6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Detach interface failed, port_id=c8837325-2bb8-4285-b48a-d5290f36d105, reason: Instance 6c79afac-4015-4d1b-beb5-ee59d051da3c could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-aecda3ae-3ea1-4b65-a568-dcd9145eecf4 req-71631e9e-1971-4482-83e6-eafba4786de6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received event network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aecda3ae-3ea1-4b65-a568-dcd9145eecf4 req-71631e9e-1971-4482-83e6-eafba4786de6 service nova] Acquiring lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aecda3ae-3ea1-4b65-a568-dcd9145eecf4 req-71631e9e-1971-4482-83e6-eafba4786de6 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aecda3ae-3ea1-4b65-a568-dcd9145eecf4 req-71631e9e-1971-4482-83e6-eafba4786de6 service nova] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-aecda3ae-3ea1-4b65-a568-dcd9145eecf4 req-71631e9e-1971-4482-83e6-eafba4786de6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] No waiting events found dispatching network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:48:01 user nova-compute[72405]: WARNING nova.compute.manager [req-aecda3ae-3ea1-4b65-a568-dcd9145eecf4 req-71631e9e-1971-4482-83e6-eafba4786de6 service nova] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Received unexpected event network-vif-plugged-c8837325-2bb8-4285-b48a-d5290f36d105 for instance with vm_state active and task_state deleting.
Aug 08 23:48:02 user nova-compute[72405]: INFO nova.compute.manager [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Took 0.76 seconds to detach 1 volumes for instance.
Aug 08 23:48:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Deleting volume: 104ea5aa-8da3-4871-afd2-c3f8afdb87d6 {{(pid=72405) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 08 23:48:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:02 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:48:02 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:48:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:03 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Deleted allocations for instance 6c79afac-4015-4d1b-beb5-ee59d051da3c
Aug 08 23:48:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-60b66274-50bb-4749-b93d-3b846f4ad201 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "6c79afac-4015-4d1b-beb5-ee59d051da3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.650s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:09 user nova-compute[72405]: INFO nova.compute.manager [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attaching volume d6a60486-341c-4694-b2d5-b1b012321de6 to /dev/vdb
Aug 08 23:48:09 user nova-compute[72405]: DEBUG os_brick.utils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da71a0-04ab-472d-8bbd-b119d44bd086]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e88ba5-dd3b-44e0-91b1-560eb8df7d4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5878fe9-9278-4921-8c61-b9f2f016563c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd31db-6578-4950-a97c-af697e02509e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:48:09 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:48:09 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c187e9-a2ed-460e-8207-9856dd99eddc]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG os_brick.utils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating existing volume attachment record: 42386ad8-660a-4273-9e13-1de10198fc4e {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:48:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:15 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538480.2596955, 6c79afac-4015-4d1b-beb5-ee59d051da3c => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:48:15 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] VM Stopped (Lifecycle Event)
Aug 08 23:48:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6b618e3d-fcbb-450d-a98c-becef65b988b None None] [instance: 6c79afac-4015-4d1b-beb5-ee59d051da3c] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:48:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzvsLoSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:48:17 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:48:17 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:48:17 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a43b80c-ea10-41c8-88c3-8418730ea11a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:48:17 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390d715-5a62-4c71-9db9-de1cbf5b3c60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6] added
Aug 08 23:48:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[78306808-b697-4bd8-9f27-5faf34938280]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f2500c-0b0a-46ae-aa16-2854e858bc71]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzvsLoSK {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzvsLoSK" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c701d769-0789-4ab4-a142-59f190ca3bd7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzvsLoSK'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[866b7d77-ae94-448e-aefa-06be8053e68b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac4d80-7919-44c2-a0c7-944402f551f9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:48:17 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:48:17 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:48:17 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 08 23:48:17 user nova-compute[72405]: 
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d471de2c-b193-4aca-b76d-4e20d6c99a34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260]
Aug 08 23:48:17 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260] successful.
Aug 08 23:48:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f987e1-0679-4486-9176-180652876471]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5979a5-f095-4070-a3ff-1c02380d3c35]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 (non-flash)
Aug 08 23:48:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 (non-flash)
Aug 08 23:48:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8809fbd5-9ee0-4190-bec5-45e8e8144089]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:48:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzvsLoSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23636663439613262', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636663439613262', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:48:18 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:48:18 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:48:18 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:48:18 user nova-compute[72405]:   <serial>d6a60486-341c-4694-b2d5-b1b012321de6</serial>
Aug 08 23:48:18 user nova-compute[72405]: </disk>
Aug 08 23:48:18 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:48:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No VIF found with MAC fa:16:3e:1d:c3:fb, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:48:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6657a0d3-ed2c-47d0-8d4a-776e1dafd68b tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.732s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:48:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:21 user nova-compute[72405]: INFO nova.compute.manager [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Detaching volume d6a60486-341c-4694-b2d5-b1b012321de6
Aug 08 23:48:21 user nova-compute[72405]: INFO nova.virt.block_device [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attempting to driver detach volume d6a60486-341c-4694-b2d5-b1b012321de6 from mountpoint /dev/vdb
Aug 08 23:48:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Attempting to detach device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:48:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:48:21 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:48:21 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:48:21 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:48:21 user nova-compute[72405]:   <serial>d6a60486-341c-4694-b2d5-b1b012321de6</serial>
Aug 08 23:48:21 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:48:21 user nova-compute[72405]: </disk>
Aug 08 23:48:21 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:48:21 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config.
Aug 08 23:48:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:48:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:48:21 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:48:21 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:48:21 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:48:21 user nova-compute[72405]:   <serial>d6a60486-341c-4694-b2d5-b1b012321de6</serial>
Aug 08 23:48:21 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:48:21 user nova-compute[72405]: </disk>
Aug 08 23:48:21 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538502.3831818, 482d453c-fbe5-4f41-8454-e290767220ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:48:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config.
Aug 08 23:48:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzvsLoSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:48:22 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4690a1c-04bc-4348-8b69-deb5c8df34e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c3dfdb-ac82-473d-acab-a02a4da16bf0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 (non-flash)
Aug 08 23:48:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 (non-flash)
Aug 08 23:48:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9815c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5128966-f68c-4c1e-88fa-5356bf38322e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9266a158-7471-4f95-8685-ebfc330613fd]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798e205-fb04-4ebf-b2be-ac85c8f9b354]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc8e534-cab7-4fb7-819c-e215cb1938dd]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ad975-556e-450c-9d9a-269738988cf8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d667a8-63ea-4190-93d1-31ea4c7e29aa]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260]
Aug 08 23:48:22 user nova-compute[72405]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6, portal: 172.16.0.220,3260] successful.
Aug 08 23:48:22 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a60486-341c-4694-b2d5-b1b012321de6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd555ec2-f8b3-4b7b-bc96-4a6d11fcfc3b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== disconnect_volume: return (298ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:48:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:48:23 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f4942a1-9aac-4c5a-b9da-e066ee104465 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG nova.compute.manager [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing instance network info cache due to event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'flavor' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updated VIF entry in instance network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG nova.network.neutron [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4753b49a-adc2-4f67-b64d-422c51b174bc req-35bcabe6-b0ea-4246-845c-79ebe2cc345d service nova] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:29 user nova-compute[72405]: INFO nova.compute.manager [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Attaching volume d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 to /dev/vdb
Aug 08 23:48:29 user nova-compute[72405]: DEBUG os_brick.utils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d811c-3344-4024-a8a8-db94117103e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ea7c28-4410-4024-ad2c-ce0a6d7a7128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff20783-59ac-4c41-b43d-11b7ce3792c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79448fa-8f2f-46a1-8325-436d0038ffd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:29 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:48:30 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:48:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e484066d-9e7b-46d1-9046-39f4b3022dd1]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG os_brick.utils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating existing volume attachment record: a5c1c443-2423-4b74-b08e-ba741d3d2085 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:48:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsAYgohj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:48:38 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:48:38 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:48:38 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24739ebf-22a0-4be1-8219-498aeefa93be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:48:38 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5e447-cc8d-4677-8672-a302ab35fb19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627] added
Aug 08 23:48:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9245746-c2f6-43dd-9c79-5220fdf82ee2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18e04b-0c04-4b7d-aa2c-8d244eadf9a6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsAYgohj {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsAYgohj" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53bb98c-d63a-4653-aa72-25dd01b31653]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vsAYgohj'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0856cb50-1543-4dd8-8206-b23eef3eed7d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e8aee9-2e3a-46a2-ad44-44ae24516542]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:48:38 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:48:38 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:48:38 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 08 23:48:38 user nova-compute[72405]: 
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e682938-317f-421f-8ce0-9cc00f610780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260]
Aug 08 23:48:38 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260] successful.
Aug 08 23:48:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c20cdb8-f872-436e-b670-5aacaefefe28]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99a246-e417-4467-87f8-f6a2340a302c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:48:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:48:38 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ca4db-1e8a-4d2f-895d-3f0bb860ee1e]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:48:38 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsAYgohj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26234393933663161', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234393933663161', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'flavor' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:48:39 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:48:39 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:48:39 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:48:39 user nova-compute[72405]:   <serial>d89b0a33-69ad-42c1-b4f8-de0fdbe3e627</serial>
Aug 08 23:48:39 user nova-compute[72405]: </disk>
Aug 08 23:48:39 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:d1:5d:44, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:48:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5b0f4741-c87b-4c24-80ce-b34587c548f4 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.064s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:40 user nova-compute[72405]: INFO nova.compute.manager [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Rescuing
Aug 08 23:48:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:48:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:48:40 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG nova.network.neutron [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-744ca604-84b3-4740-adab-867740b429cb req-c4c22d41-66f5-4b2f-9a39-9722a987a6eb service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-744ca604-84b3-4740-adab-867740b429cb req-c4c22d41-66f5-4b2f-9a39-9722a987a6eb service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-744ca604-84b3-4740-adab-867740b429cb req-c4c22d41-66f5-4b2f-9a39-9722a987a6eb service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-744ca604-84b3-4740-adab-867740b429cb req-c4c22d41-66f5-4b2f-9a39-9722a987a6eb service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:41 user nova-compute[72405]: DEBUG nova.compute.manager [req-744ca604-84b3-4740-adab-867740b429cb req-c4c22d41-66f5-4b2f-9a39-9722a987a6eb service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:48:41 user nova-compute[72405]: WARNING nova.compute.manager [req-744ca604-84b3-4740-adab-867740b429cb req-c4c22d41-66f5-4b2f-9a39-9722a987a6eb service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state active and task_state rescuing.
Aug 08 23:48:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance destroyed successfully.
Aug 08 23:48:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Attempting rescue
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72405) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance directory exists: not creating {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 08 23:48:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Creating image(s)
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'trusted_certs' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue" returned: 0 in 0.050s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'migration_context' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Start _get_guest_xml network_info=[{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:d1:5d:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'resources' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'numa_topology' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:48:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:48:42 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'vcpu_model' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1411537504',display_name='tempest-ServerRescueNegativeTestJSON-server-1411537504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1411537504',id=44,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjtq0R9wy//PGrzT3CMMKz4cOXoiolU4oLvX9Mp/t7B/3mI/kAnGdMQpmpkbjvaJKMt1IXTTdtbpdJz0DnIpZ5gla+qPOVGx+RgCGzgfyhZ8Xh45ie8NWT+Kps1hgoYPA==',key_name='tempest-keypair-1596600579',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-wfp2grvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=d46f8020-b843-442b-b6f9-709536a8d419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:d1:5d:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "vif_mac": "fa:16:3e:d1:5d:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'pci_devices' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:48:42 user nova-compute[72405]:   <uuid>d46f8020-b843-442b-b6f9-709536a8d419</uuid>
Aug 08 23:48:42 user nova-compute[72405]:   <name>instance-0000002c</name>
Aug 08 23:48:42 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:48:42 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:48:42 user nova-compute[72405]:   <metadata>
Aug 08 23:48:42 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:48:42 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:48:42 user nova-compute[72405]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1411537504</nova:name>
Aug 08 23:48:42 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:48:42</nova:creationTime>
Aug 08 23:48:42 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:48:42 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:48:42 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:48:42 user nova-compute[72405]:       <nova:owner>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:user uuid="94a805b078b640c29ae13aabfd1fd5a5">tempest-ServerRescueNegativeTestJSON-297666519-project-member</nova:user>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:project uuid="93111863a9dc43b9a50c61a6c1f4c52c">tempest-ServerRescueNegativeTestJSON-297666519</nova:project>
Aug 08 23:48:42 user nova-compute[72405]:       </nova:owner>
Aug 08 23:48:42 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:48:42 user nova-compute[72405]:       <nova:ports>
Aug 08 23:48:42 user nova-compute[72405]:         <nova:port uuid="d3da762d-06c5-455d-bd9e-ae602fdd4c0c">
Aug 08 23:48:42 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 08 23:48:42 user nova-compute[72405]:         </nova:port>
Aug 08 23:48:42 user nova-compute[72405]:       </nova:ports>
Aug 08 23:48:42 user nova-compute[72405]:     </nova:instance>
Aug 08 23:48:42 user nova-compute[72405]:   </metadata>
Aug 08 23:48:42 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:48:42 user nova-compute[72405]:     <system>
Aug 08 23:48:42 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:48:42 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:48:42 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:48:42 user nova-compute[72405]:       <entry name="serial">d46f8020-b843-442b-b6f9-709536a8d419</entry>
Aug 08 23:48:42 user nova-compute[72405]:       <entry name="uuid">d46f8020-b843-442b-b6f9-709536a8d419</entry>
Aug 08 23:48:42 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:48:42 user nova-compute[72405]:     </system>
Aug 08 23:48:42 user nova-compute[72405]:   </sysinfo>
Aug 08 23:48:42 user nova-compute[72405]:   <os>
Aug 08 23:48:42 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:48:42 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:48:42 user nova-compute[72405]:   </os>
Aug 08 23:48:42 user nova-compute[72405]:   <features>
Aug 08 23:48:42 user nova-compute[72405]:     <acpi/>
Aug 08 23:48:42 user nova-compute[72405]:     <apic/>
Aug 08 23:48:42 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:48:42 user nova-compute[72405]:   </features>
Aug 08 23:48:42 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:48:42 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:48:42 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:48:42 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:48:42 user nova-compute[72405]:   </clock>
Aug 08 23:48:42 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:48:42 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:48:42 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:48:42 user nova-compute[72405]:   </cpu>
Aug 08 23:48:42 user nova-compute[72405]:   <devices>
Aug 08 23:48:42 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:48:42 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:48:42 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue"/>
Aug 08 23:48:42 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:48:42 user nova-compute[72405]:     </disk>
Aug 08 23:48:42 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:48:42 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:48:42 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk"/>
Aug 08 23:48:42 user nova-compute[72405]:       <target dev="vdb" bus="virtio"/>
Aug 08 23:48:42 user nova-compute[72405]:     </disk>
Aug 08 23:48:42 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:48:42 user nova-compute[72405]:       <mac address="fa:16:3e:d1:5d:44"/>
Aug 08 23:48:42 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:48:42 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:48:42 user nova-compute[72405]:       <target dev="tapd3da762d-06"/>
Aug 08 23:48:42 user nova-compute[72405]:     </interface>
Aug 08 23:48:42 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:48:42 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/console.log" append="off"/>
Aug 08 23:48:42 user nova-compute[72405]:     </serial>
Aug 08 23:48:42 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:48:42 user nova-compute[72405]:     <video>
Aug 08 23:48:42 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:48:42 user nova-compute[72405]:     </video>
Aug 08 23:48:42 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:48:42 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:48:42 user nova-compute[72405]:     </rng>
Aug 08 23:48:42 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:48:42 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:48:42 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:48:42 user nova-compute[72405]:     </memballoon>
Aug 08 23:48:42 user nova-compute[72405]:   </devices>
Aug 08 23:48:42 user nova-compute[72405]: </domain>
Aug 08 23:48:42 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:48:42 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance destroyed successfully.
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:48:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] No VIF found with MAC fa:16:3e:d1:5d:44, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:48:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-f3599abb-6ff4-40a3-99a2-53791d4d4c13 req-d9eb37ff-6711-4d24-be26-3d09bf27f103 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f3599abb-6ff4-40a3-99a2-53791d4d4c13 req-d9eb37ff-6711-4d24-be26-3d09bf27f103 service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f3599abb-6ff4-40a3-99a2-53791d4d4c13 req-d9eb37ff-6711-4d24-be26-3d09bf27f103 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-f3599abb-6ff4-40a3-99a2-53791d4d4c13 req-d9eb37ff-6711-4d24-be26-3d09bf27f103 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-f3599abb-6ff4-40a3-99a2-53791d4d4c13 req-d9eb37ff-6711-4d24-be26-3d09bf27f103 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:48:44 user nova-compute[72405]: WARNING nova.compute.manager [req-f3599abb-6ff4-40a3-99a2-53791d4d4c13 req-d9eb37ff-6711-4d24-be26-3d09bf27f103 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state active and task_state rescuing.
Aug 08 23:48:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:48:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:48:46 user nova-compute[72405]: WARNING nova.compute.manager [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state active and task_state rescuing.
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:48:46 user nova-compute[72405]: WARNING nova.compute.manager [req-66baad7a-6c6f-43e4-a5eb-f9c743fc10e7 req-3b8c1670-2963-44d7-91cd-2992d6dc4132 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state active and task_state rescuing.
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for d46f8020-b843-442b-b6f9-709536a8d419 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538526.1272204, d46f8020-b843-442b-b6f9-709536a8d419 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:48:46 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Resumed (Lifecycle Event)
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5444594c-2c7c-4a77-8477-51866ae22c59 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:48:46 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538526.1274261, d46f8020-b843-442b-b6f9-709536a8d419 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:48:46 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Started (Lifecycle Event)
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:48:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:48:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:48:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:48:47 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:48:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:48:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:48:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:48:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:48:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:48:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:51 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:48:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:48:54 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:48:54 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=25.136539459228516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:48:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:48:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:48:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:49:03 user nova-compute[72405]: INFO nova.compute.claims [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Claim successful on node user
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:49:03 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:49:03 user nova-compute[72405]: INFO nova.virt.block_device [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Booting with volume 05a3a61b-8845-4b00-a80c-8b944cb4b289 at /dev/vda
Aug 08 23:49:03 user nova-compute[72405]: DEBUG nova.policy [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246e22061eb47eda51b4b6634102922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc0496a99448ce8705555dc3ed9c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG os_brick.utils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[36de1fbc-ee9b-4e23-b3dd-1b78033b8ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e869f0-5e44-43c9-9d43-f928bf3ed3dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:03 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ced6e5-0415-49ff-b23d-cfafb3b1b01d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca7084-c323-4364-ad27-73a6eb3b0369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:49:04 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:49:04 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baad8cc-00d4-4642-bd53-f7c2858f3c54]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG os_brick.utils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updating existing volume attachment record: c7580b29-acbe-4d59-8152-b4191b9ca41e {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Successfully created port: edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:49:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'flavor' on Instance uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Successfully updated port: edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquired lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-changed-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.compute.manager [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Refreshing instance network info cache due to event network-changed-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] Acquiring lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:05 user nova-compute[72405]: INFO nova.compute.manager [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Attaching volume 9ed49423-63db-458b-8d87-48c975ab2033 to /dev/vdb
Aug 08 23:49:05 user nova-compute[72405]: DEBUG os_brick.utils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0080fa4-cd1f-4e6b-a19f-2ed4201094e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b7f246-715e-4fec-8385-9015a6736640]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updating instance_info_cache with network_info: [{"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38b87e3-8c64-4890-9a56-6541a73de2fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb8a95-6dde-4bff-84d8-dc91c71aa98a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Releasing lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Instance network_info: |[{"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] Acquired lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.network.neutron [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Refreshing network info cache for port edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:49:05 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:49:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b36c7-d19c-42ad-a92c-1f23a6aca39b]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG os_brick.utils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:05 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating existing volume attachment record: 04122006-7fb4-407a-9457-a629bb0abf1f {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:49:06 user nova-compute[72405]: DEBUG nova.network.neutron [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updated VIF entry in instance network info cache for port edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:49:06 user nova-compute[72405]: DEBUG nova.network.neutron [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updating instance_info_cache with network_info: [{"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:49:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-34a0f4ab-274c-4345-8faa-5b24e8cf70a5 req-e25b4c1c-20ec-4f05-aac7-c80435e64866 service nova] Releasing lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:49:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:49:13 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Creating image(s)
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Ensure instance console log exists: /opt/stack/data/nova/instances/696fb05d-9eda-44c3-b067-e7c0852aa8a9/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Start _get_guest_xml network_info=[{"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c7580b29-acbe-4d59-8152-b4191b9ca41e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '696fb05d-9eda-44c3-b067-e7c0852aa8a9', 'attached_at': '', 'detached_at': '', 'volume_id': '05a3a61b-8845-4b00-a80c-8b944cb4b289', 'serial': '05a3a61b-8845-4b00-a80c-8b944cb4b289'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:49:13 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:49:13 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:13 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:13 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:13 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe86dba-8180-4df7-bddc-34fdd61b2943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:49:13 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3b3d4-f025-438e-a6d5-5afd3d95ae2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289] added
Aug 08 23:49:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5d18a-3ca3-40c6-837c-d135581a0527]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[54df041d-2fbc-4aef-9e1b-9417b428106c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdfIFvKm {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdfIFvKm" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8715ab67-871a-482f-8a33-bf24a006bcef]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdfIFvKm'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8fed9d-8c06-4efa-b7d8-eec017b3bd53]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e635b-8237-4cc8-8874-98e0f83c5da2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932ad80-a95c-4976-9dac-528e42cf3099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]
Aug 08 23:49:13 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.
Aug 08 23:49:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af9be68-2d5c-46f9-ba1f-ea1dbc9c6905]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d97907-8610-4879-a60f-c327b452af2b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:13 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:13 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f0b32-eca6-43c1-8ecc-e6ec4ab9d2ad]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:49:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23438326637656435', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438326637656435', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-89146146',display_name='tempest-TestVolumeBootPattern-server-89146146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-89146146',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-326seax3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:49:04Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=696fb05d-9eda-44c3-b067-e7c0852aa8a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.objects.instance [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'pci_devices' on Instance uuid 696fb05d-9eda-44c3-b067-e7c0852aa8a9 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CScKJewa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:14 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:14 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:14 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:49:14 user nova-compute[72405]:   <uuid>696fb05d-9eda-44c3-b067-e7c0852aa8a9</uuid>
Aug 08 23:49:14 user nova-compute[72405]:   <name>instance-0000002e</name>
Aug 08 23:49:14 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:49:14 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:49:14 user nova-compute[72405]:   <metadata>
Aug 08 23:49:14 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:49:14 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:49:14 user nova-compute[72405]:       <nova:name>tempest-TestVolumeBootPattern-server-89146146</nova:name>
Aug 08 23:49:14 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:49:13</nova:creationTime>
Aug 08 23:49:14 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:49:14 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:49:14 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:49:14 user nova-compute[72405]:       <nova:owner>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:user uuid="a246e22061eb47eda51b4b6634102922">tempest-TestVolumeBootPattern-1873778230-project-member</nova:user>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:project uuid="bffc0496a99448ce8705555dc3ed9c45">tempest-TestVolumeBootPattern-1873778230</nova:project>
Aug 08 23:49:14 user nova-compute[72405]:       </nova:owner>
Aug 08 23:49:14 user nova-compute[72405]:       <nova:ports>
Aug 08 23:49:14 user nova-compute[72405]:         <nova:port uuid="edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a">
Aug 08 23:49:14 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 08 23:49:14 user nova-compute[72405]:         </nova:port>
Aug 08 23:49:14 user nova-compute[72405]:       </nova:ports>
Aug 08 23:49:14 user nova-compute[72405]:     </nova:instance>
Aug 08 23:49:14 user nova-compute[72405]:   </metadata>
Aug 08 23:49:14 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:49:14 user nova-compute[72405]:     <system>
Aug 08 23:49:14 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:49:14 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:49:14 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:49:14 user nova-compute[72405]:       <entry name="serial">696fb05d-9eda-44c3-b067-e7c0852aa8a9</entry>
Aug 08 23:49:14 user nova-compute[72405]:       <entry name="uuid">696fb05d-9eda-44c3-b067-e7c0852aa8a9</entry>
Aug 08 23:49:14 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:49:14 user nova-compute[72405]:     </system>
Aug 08 23:49:14 user nova-compute[72405]:   </sysinfo>
Aug 08 23:49:14 user nova-compute[72405]:   <os>
Aug 08 23:49:14 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:49:14 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:49:14 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:49:14 user nova-compute[72405]:   </os>
Aug 08 23:49:14 user nova-compute[72405]:   <features>
Aug 08 23:49:14 user nova-compute[72405]:     <acpi/>
Aug 08 23:49:14 user nova-compute[72405]:     <apic/>
Aug 08 23:49:14 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:49:14 user nova-compute[72405]:   </features>
Aug 08 23:49:14 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:49:14 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:49:14 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:49:14 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:49:14 user nova-compute[72405]:   </clock>
Aug 08 23:49:14 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:49:14 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:49:14 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:49:14 user nova-compute[72405]:   </cpu>
Aug 08 23:49:14 user nova-compute[72405]:   <devices>
Aug 08 23:49:14 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:49:14 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:49:14 user nova-compute[72405]:       <source dev="/dev/sdc"/>
Aug 08 23:49:14 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:49:14 user nova-compute[72405]:       <serial>05a3a61b-8845-4b00-a80c-8b944cb4b289</serial>
Aug 08 23:49:14 user nova-compute[72405]:     </disk>
Aug 08 23:49:14 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:49:14 user nova-compute[72405]:       <mac address="fa:16:3e:e5:70:8f"/>
Aug 08 23:49:14 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:49:14 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:49:14 user nova-compute[72405]:       <target dev="tapedd4dd3f-74"/>
Aug 08 23:49:14 user nova-compute[72405]:     </interface>
Aug 08 23:49:14 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:49:14 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/696fb05d-9eda-44c3-b067-e7c0852aa8a9/console.log" append="off"/>
Aug 08 23:49:14 user nova-compute[72405]:     </serial>
Aug 08 23:49:14 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:49:14 user nova-compute[72405]:     <video>
Aug 08 23:49:14 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:49:14 user nova-compute[72405]:     </video>
Aug 08 23:49:14 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:49:14 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:49:14 user nova-compute[72405]:     </rng>
Aug 08 23:49:14 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:49:14 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:49:14 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:49:14 user nova-compute[72405]:     </memballoon>
Aug 08 23:49:14 user nova-compute[72405]:   </devices>
Aug 08 23:49:14 user nova-compute[72405]: </domain>
Aug 08 23:49:14 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-89146146',display_name='tempest-TestVolumeBootPattern-server-89146146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-89146146',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-326seax3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:49:04Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=696fb05d-9eda-44c3-b067-e7c0852aa8a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_vif [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd4dd3f-74, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapedd4dd3f-74, col_values=(('external_ids', {'iface-id': 'edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:70:8f', 'vm-uuid': '696fb05d-9eda-44c3-b067-e7c0852aa8a9'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70b91f-947c-4a48-acb2-667096dbdec5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:49:14 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:14 user nova-compute[72405]: INFO os_vif [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74')
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2704ef5d-5b04-4173-9cc7-ca96bef2aeca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033] added
Aug 08 23:49:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c4e9b6-15a1-4478-992e-6e625ae57d61]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No VIF found with MAC fa:16:3e:e5:70:8f, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d79c16-2999-49cf-af51-b02eb46479e8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CScKJewa {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CScKJewa" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[30231e44-2bfb-464e-804d-c774ca5da159]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CScKJewa'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[23004a93-dad8-42f4-8743-28c00504c413]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f401a6a5-5e86-469e-91f3-23ca9b7b6edb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2a76d-1c65-4a62-96b4-46122e4ade38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260]
Aug 08 23:49:14 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260] successful.
Aug 08 23:49:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a255b1af-c503-4dfb-892d-908922ce854d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9f6a9c-3696-43b2-bd29-ce64cf400614]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:14 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de4c9a-b3f4-4f9a-8c0b-6353fda27545]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:49:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CScKJewa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26334316337356338', 'path': '/dev/sdd'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334316337356338', 'path': '/dev/sdd'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'flavor' on Instance uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:49:15 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:49:15 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:49:15 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:49:15 user nova-compute[72405]:   <serial>9ed49423-63db-458b-8d87-48c975ab2033</serial>
Aug 08 23:49:15 user nova-compute[72405]: </disk>
Aug 08 23:49:15 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-c81ca2f2-91c0-4454-a108-3c21fa7e54c7 req-307eac55-415d-4c63-862e-b5c4bb7ab6ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c81ca2f2-91c0-4454-a108-3c21fa7e54c7 req-307eac55-415d-4c63-862e-b5c4bb7ab6ee service nova] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c81ca2f2-91c0-4454-a108-3c21fa7e54c7 req-307eac55-415d-4c63-862e-b5c4bb7ab6ee service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c81ca2f2-91c0-4454-a108-3c21fa7e54c7 req-307eac55-415d-4c63-862e-b5c4bb7ab6ee service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-c81ca2f2-91c0-4454-a108-3c21fa7e54c7 req-307eac55-415d-4c63-862e-b5c4bb7ab6ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] No waiting events found dispatching network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:49:16 user nova-compute[72405]: WARNING nova.compute.manager [req-c81ca2f2-91c0-4454-a108-3c21fa7e54c7 req-307eac55-415d-4c63-862e-b5c4bb7ab6ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received unexpected event network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a for instance with vm_state building and task_state spawning.
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:16 user nova-compute[72405]: INFO nova.compute.manager [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attaching volume e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 to /dev/vdb
Aug 08 23:49:16 user nova-compute[72405]: DEBUG os_brick.utils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6440e43-18fb-42f1-bc54-c32d1ae39d9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017d87d-c25b-4c67-8721-8fd110d1e4c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e318a30c-3555-4174-9273-e15367bd1925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e7eba-536a-4479-b414-632ac1d77e99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:49:16 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[279fbb66-454e-4a8f-9ded-b43f924e9d70]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG os_brick.utils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating existing volume attachment record: 78c0c9a8-9f92-45d6-a918-295e34a24fc1 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] No VIF found with MAC fa:16:3e:7b:d7:11, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:49:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6418ca0e-d9c9-4033-8c46-61fdcba4b1b4 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.152s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-4bd4ad3a-86e9-4102-8991-4e82d4c03f6e req-af1756ef-92d2-4fdf-ada4-67bb8b6066ab service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4bd4ad3a-86e9-4102-8991-4e82d4c03f6e req-af1756ef-92d2-4fdf-ada4-67bb8b6066ab service nova] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4bd4ad3a-86e9-4102-8991-4e82d4c03f6e req-af1756ef-92d2-4fdf-ada4-67bb8b6066ab service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4bd4ad3a-86e9-4102-8991-4e82d4c03f6e req-af1756ef-92d2-4fdf-ada4-67bb8b6066ab service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-4bd4ad3a-86e9-4102-8991-4e82d4c03f6e req-af1756ef-92d2-4fdf-ada4-67bb8b6066ab service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] No waiting events found dispatching network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:49:18 user nova-compute[72405]: WARNING nova.compute.manager [req-4bd4ad3a-86e9-4102-8991-4e82d4c03f6e req-af1756ef-92d2-4fdf-ada4-67bb8b6066ab service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received unexpected event network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a for instance with vm_state building and task_state spawning.
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538558.6324944, 696fb05d-9eda-44c3-b067-e7c0852aa8a9 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] VM Resumed (Lifecycle Event)
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Instance spawned successfully.
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538558.6349232, 696fb05d-9eda-44c3-b067-e7c0852aa8a9 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] VM Started (Lifecycle Event)
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 08 23:49:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:18 user nova-compute[72405]: INFO nova.compute.manager [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Took 15.48 seconds to build instance.
Aug 08 23:49:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-06a8d694-eecf-4973-a30c-db0bb6e0a8f2 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.577s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing instance network info cache due to event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG nova.network.neutron [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG nova.network.neutron [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updated VIF entry in instance network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG nova.network.neutron [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:49:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a276878c-6871-4409-ac91-6f7778baa5f6 req-82d6cf72-2ce4-456a-9d98-572609074f1c service nova] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:49:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing instance network info cache due to event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:49:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:49:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:49:22 user nova-compute[72405]: DEBUG nova.network.neutron [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG nova.network.neutron [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updated VIF entry in instance network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG nova.network.neutron [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e3929b5e-dc0c-4a3e-9b0b-e7e4a14a8ff9 req-a3bb956f-b595-4a4b-82a1-31823ccd77bb service nova] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:23 user nova-compute[72405]: INFO nova.compute.manager [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Rebooting instance
Aug 08 23:49:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG nova.network.neutron [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG nova.network.neutron [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:49:23 user nova-compute[72405]: DEBUG nova.compute.manager [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncvuhoZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:25 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:25 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5beccfb-f8ce-4bf1-a93b-64af676d5c7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:49:25 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed57c60-8b52-4d6e-9f13-50305109bd9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28] added
Aug 08 23:49:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cc7887-3af7-4c76-9c14-adc22023c889]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f6159-ec59-4a35-a73e-4b30e145dcc0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncvuhoZw {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncvuhoZw" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9928bce8-83d5-4eff-b903-e87f6f41b0b0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncvuhoZw'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[203bc7a6-20ee-40d6-b125-59f648a00e44]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b40ea-bd3d-4d57-90a9-9ed834c05aad]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5254971f-f36b-4a47-8ae2-f2ee26d4ad92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260]
Aug 08 23:49:25 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260] successful.
Aug 08 23:49:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ded882-1f58-4a3e-8d65-8a93d3347d17]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e851c-c41f-4e0b-92a6-dd71b3527cee]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 (non-flash)
Aug 08 23:49:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] HCTL ('36', '-', '-', 0) found on session 58 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f50bb4a-4d17-4b1a-810e-e9a14f911c49]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Searching for a device in session 58 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:49:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncvuhoZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-b1150fad-5a2e-42af-a723-94cbc303d62b req-3f004ce1-110f-4588-97ac-109f778b77d8 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-unplugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b1150fad-5a2e-42af-a723-94cbc303d62b req-3f004ce1-110f-4588-97ac-109f778b77d8 service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b1150fad-5a2e-42af-a723-94cbc303d62b req-3f004ce1-110f-4588-97ac-109f778b77d8 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b1150fad-5a2e-42af-a723-94cbc303d62b req-3f004ce1-110f-4588-97ac-109f778b77d8 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-b1150fad-5a2e-42af-a723-94cbc303d62b req-3f004ce1-110f-4588-97ac-109f778b77d8 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-unplugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:49:26 user nova-compute[72405]: WARNING nova.compute.manager [req-b1150fad-5a2e-42af-a723-94cbc303d62b req-3f004ce1-110f-4588-97ac-109f778b77d8 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-unplugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state active and task_state reboot_started.
Aug 08 23:49:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26166376239323961', 'path': '/dev/sde'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166376239323961', 'path': '/dev/sde'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:49:26 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:49:26 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:49:26 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:49:26 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:49:26 user nova-compute[72405]:   <serial>e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28</serial>
Aug 08 23:49:26 user nova-compute[72405]: </disk>
Aug 08 23:49:26 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:49:26 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance shutdown successfully.
Aug 08 23:49:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:49:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:49:27 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] No VIF found with MAC fa:16:3e:1d:c3:fb, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:49:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8c68cf5e-2905-45be-ba57-03161a2c801d tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.864s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f2dc3f7-12f7-4411-9473-32d9f94678b1 req-0a68a746-48cc-4399-9c6b-c2d4a489c1dd service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f2dc3f7-12f7-4411-9473-32d9f94678b1 req-0a68a746-48cc-4399-9c6b-c2d4a489c1dd service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f2dc3f7-12f7-4411-9473-32d9f94678b1 req-0a68a746-48cc-4399-9c6b-c2d4a489c1dd service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f2dc3f7-12f7-4411-9473-32d9f94678b1 req-0a68a746-48cc-4399-9c6b-c2d4a489c1dd service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:28 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f2dc3f7-12f7-4411-9473-32d9f94678b1 req-0a68a746-48cc-4399-9c6b-c2d4a489c1dd service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:49:28 user nova-compute[72405]: WARNING nova.compute.manager [req-1f2dc3f7-12f7-4411-9473-32d9f94678b1 req-0a68a746-48cc-4399-9c6b-c2d4a489c1dd service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state active and task_state reboot_started.
Aug 08 23:49:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.compute.manager [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Detaching volume e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.virt.block_device [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Attempting to driver detach volume e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 from mountpoint /dev/vdb
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Attempting to detach device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:49:30 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:49:30 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:49:30 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:49:30 user nova-compute[72405]:   <serial>e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28</serial>
Aug 08 23:49:30 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:49:30 user nova-compute[72405]: </disk>
Aug 08 23:49:30 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the persistent domain config.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:49:30 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:49:30 user nova-compute[72405]:   <source dev="/dev/sde"/>
Aug 08 23:49:30 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:49:30 user nova-compute[72405]:   <serial>e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28</serial>
Aug 08 23:49:30 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:49:30 user nova-compute[72405]: </disk>
Aug 08 23:49:30 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:49:30 user nova-compute[72405]: WARNING nova.compute.manager [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state active and task_state reboot_started.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:49:30 user nova-compute[72405]: WARNING nova.compute.manager [req-418994ea-037b-43df-87ca-c77666fd8874 req-2622e3c3-9ff1-4fb7-ad02-c910504a2659 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state active and task_state reboot_started.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for 5585ea20-9eb7-47c3-8b03-4c8253a7864f due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538570.4585598, 5585ea20-9eb7-47c3-8b03-4c8253a7864f => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] VM Resumed (Lifecycle Event)
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance running successfully.
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance soft rebooted successfully.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538570.4622273, 5585ea20-9eb7-47c3-8b03-4c8253a7864f => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] VM Started (Lifecycle Event)
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-51b173ea-aecc-420d-a997-31717adacdfe tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.361s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538570.5772305, 482d453c-fbe5-4f41-8454-e290767220ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:49:30 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully detached device vdb from instance 482d453c-fbe5-4f41-8454-e290767220ed from the live domain config.
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncvuhoZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:49:30 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ce9ac-fd14-4040-af21-ff797363a069]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4925be5e-6e43-4466-a88f-aa16e69b8b99]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 (non-flash)
Aug 08 23:49:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781a12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28'): ({'sde'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Removing single pathed devices sde {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[76628b7c-717e-4c25-ad39-9ea68fdd93b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b27b1f7-ff95-498f-9531-aefced91c89d]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Flushing IO for device /dev/sde {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa614d6-693f-4e6f-91cc-58e510ee3c18]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dbe445-cd7c-478e-97e8-f725f2d63d93]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] SCSI volumes sde have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fcfe01-12cd-4c7a-b0a7-2dfdb017e160]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3122a89-cc34-4be9-902b-67facceb202f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260]
Aug 08 23:49:30 user nova-compute[72405]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28, portal: 172.16.0.220,3260] successful.
Aug 08 23:49:30 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d1fb99-e6f3-4bf9-ac93-3e2d56894d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60f1a5-45f6-405e-8dd3-72e244f46adb]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] <== disconnect_volume: return (295ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:49:30 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:49:31 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'flavor' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:49:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6715be87-68b7-4475-9983-4663bc017db8 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Triggering sync for uuid 696fb05d-9eda-44c3-b067-e7c0852aa8a9 {{(pid=72405) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "d46f8020-b843-442b-b6f9-709536a8d419" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "d46f8020-b843-442b-b6f9-709536a8d419" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:37 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:49:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:50 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating instance_info_cache with network_info: [{"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:49:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-482d453c-fbe5-4f41-8454-e290767220ed" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:49:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:49:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:49:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:49:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:49:55 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=7930MB free_disk=25.123939514160156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:49:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 696fb05d-9eda-44c3-b067-e7c0852aa8a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:49:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:49:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:49:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:49:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:50:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:31 user nova-compute[72405]: INFO nova.compute.manager [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Unrescuing
Aug 08 23:50:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:50:31 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:50:31 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG nova.network.neutron [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG nova.objects.instance [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'flavor' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-b481c485-1d0c-4786-a9bc-060ea8207e45 req-01238fc8-f85c-41ab-b577-1b27b5d1bf1d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b481c485-1d0c-4786-a9bc-060ea8207e45 req-01238fc8-f85c-41ab-b577-1b27b5d1bf1d service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b481c485-1d0c-4786-a9bc-060ea8207e45 req-01238fc8-f85c-41ab-b577-1b27b5d1bf1d service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-b481c485-1d0c-4786-a9bc-060ea8207e45 req-01238fc8-f85c-41ab-b577-1b27b5d1bf1d service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG nova.compute.manager [req-b481c485-1d0c-4786-a9bc-060ea8207e45 req-01238fc8-f85c-41ab-b577-1b27b5d1bf1d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:32 user nova-compute[72405]: WARNING nova.compute.manager [req-b481c485-1d0c-4786-a9bc-060ea8207e45 req-01238fc8-f85c-41ab-b577-1b27b5d1bf1d service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:50:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:33 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance destroyed successfully.
Aug 08 23:50:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:34 user nova-compute[72405]: WARNING nova.compute.manager [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:50:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:34 user nova-compute[72405]: DEBUG nova.compute.manager [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:34 user nova-compute[72405]: WARNING nova.compute.manager [req-df09ce25-6fbb-4345-aefe-9e4990e69c67 req-7cc01631-badf-4126-a69d-18eae9c69def service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state rescued and task_state unrescuing.
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Removed pending event for d46f8020-b843-442b-b6f9-709536a8d419 due to event {{(pid=72405) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538636.6808789, d46f8020-b843-442b-b6f9-709536a8d419 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:50:36 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Resumed (Lifecycle Event)
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-fde4fe8b-cd2d-48fa-bb96-269b724ecab9 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:50:36 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538636.6865268, d46f8020-b843-442b-b6f9-709536a8d419 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:50:36 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Started (Lifecycle Event)
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [req-9bd71a97-2e3a-43e7-ac21-a011576ae84c req-9791fae0-48ff-4712-b44e-3719a2d1b117 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9bd71a97-2e3a-43e7-ac21-a011576ae84c req-9791fae0-48ff-4712-b44e-3719a2d1b117 service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9bd71a97-2e3a-43e7-ac21-a011576ae84c req-9791fae0-48ff-4712-b44e-3719a2d1b117 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9bd71a97-2e3a-43e7-ac21-a011576ae84c req-9791fae0-48ff-4712-b44e-3719a2d1b117 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:36 user nova-compute[72405]: DEBUG nova.compute.manager [req-9bd71a97-2e3a-43e7-ac21-a011576ae84c req-9791fae0-48ff-4712-b44e-3719a2d1b117 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:36 user nova-compute[72405]: WARNING nova.compute.manager [req-9bd71a97-2e3a-43e7-ac21-a011576ae84c req-9791fae0-48ff-4712-b44e-3719a2d1b117 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state active and task_state None.
Aug 08 23:50:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:45 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:50:51 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:50:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:50:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:50:51 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-changed-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG nova.compute.manager [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Refreshing instance network info cache due to event network-changed-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] Acquiring lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] Acquired lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG nova.network.neutron [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Refreshing network info cache for port edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:50:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:50:55 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:50:55 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8044MB free_disk=25.122413635253906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:56 user nova-compute[72405]: INFO nova.compute.manager [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Terminating instance
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 482d453c-fbe5-4f41-8454-e290767220ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 696fb05d-9eda-44c3-b067-e7c0852aa8a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:56 user nova-compute[72405]: INFO nova.compute.manager [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Terminating instance
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9128d76-b872-4d1c-821b-7a0663886fcf req-464a6d62-8f8c-49fc-adf6-d465c88b3569 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-unplugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9128d76-b872-4d1c-821b-7a0663886fcf req-464a6d62-8f8c-49fc-adf6-d465c88b3569 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9128d76-b872-4d1c-821b-7a0663886fcf req-464a6d62-8f8c-49fc-adf6-d465c88b3569 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d9128d76-b872-4d1c-821b-7a0663886fcf req-464a6d62-8f8c-49fc-adf6-d465c88b3569 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9128d76-b872-4d1c-821b-7a0663886fcf req-464a6d62-8f8c-49fc-adf6-d465c88b3569 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-unplugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.compute.manager [req-d9128d76-b872-4d1c-821b-7a0663886fcf req-464a6d62-8f8c-49fc-adf6-d465c88b3569 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-unplugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.network.neutron [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updated VIF entry in instance network info cache for port edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG nova.network.neutron [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updating instance_info_cache with network_info: [{"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-89cde53e-d16e-47f7-9871-a73c2d2e7b3e req-73acaf83-7636-4fdd-8930-bac591cea7ee service nova] Releasing lock "refresh_cache-696fb05d-9eda-44c3-b067-e7c0852aa8a9" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Instance destroyed successfully.
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lazy-loading 'resources' on Instance uuid 482d453c-fbe5-4f41-8454-e290767220ed {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Instance destroyed successfully.
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'resources' on Instance uuid 696fb05d-9eda-44c3-b067-e7c0852aa8a9 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2035139068',display_name='tempest-SnapshotDataIntegrityTests-server-2035139068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2035139068',id=42,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8EBWNnfbvP4DI3cYCDC1Y4eckA+FejcIKogLPuWgGn4jk8CLVjiQFPnNmwpxmlgyeXKcWm0acsicn53X6Vtw6Cw2h75FLsaJEdydvypqY3ovYI4nAQXzF43+uKjwSpxg==',key_name='tempest-keypair-22172130',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:43:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47a46f0ded804d8990fdfaa0c4f88254',ramdisk_id='',reservation_id='r-s7e5dg47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-794286815',owner_user_name='tempest-SnapshotDataIntegrityTests-794286815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:43:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8588adf046ef40e79ff6e840261510f8',uuid=482d453c-fbe5-4f41-8454-e290767220ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Converting VIF {"id": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "address": "fa:16:3e:1d:c3:fb", "network": {"id": "4e0215e2-aee9-4227-a4fb-d3a6b730094b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472292849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a46f0ded804d8990fdfaa0c4f88254", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ad7ceb-58", "ovs_interfaceid": "f5ad7ceb-586f-46af-9461-a31ff59bf87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_vif [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-89146146',display_name='tempest-TestVolumeBootPattern-server-89146146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-89146146',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:49:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-326seax3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:49:19Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=696fb05d-9eda-44c3-b067-e7c0852aa8a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "address": "fa:16:3e:e5:70:8f", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4dd3f-74", "ovs_interfaceid": "edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_vif [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5ad7ceb-58, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd4dd3f-74, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: INFO os_vif [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=f5ad7ceb-586f-46af-9461-a31ff59bf87e,network=Network(4e0215e2-aee9-4227-a4fb-d3a6b730094b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ad7ceb-58')
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Deleting instance files /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed_del
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Deletion of /opt/stack/data/nova/instances/482d453c-fbe5-4f41-8454-e290767220ed_del complete
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:50:57 user nova-compute[72405]: INFO os_vif [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:8f,bridge_name='br-int',has_traffic_filtering=True,id=edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4dd3f-74')
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:50:57 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d860e4a-f7ff-4b47-8a2a-3bdb51ed21ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.compute.manager [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6733e8-fead-4b4e-bca5-6f82eed8d558]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:50:57 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:50:57 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:50:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:50:57 user nova-compute[72405]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:50:57 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:50:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb7851e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e15a8c-ddb7-4ded-8688-678b7928a72a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[86440829-18cd-4ff3-ad80-2cd22070d23b]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71edd49-761f-4b89-b3ae-9888ac9258f9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[38768e69-d116-4698-b89c-38c943458e6e]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe8186eec-482f7ed50667eadf', '/dev/disk/by-id/scsi-23438326637656435', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8186eec') {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce06dd6-d339-4d26-b7a7-656ad192078d]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef82075b-a82e-42fb-8a3a-4c45478de341]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6484e4-ae95-4dff-8847-1312ca98163e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]
Aug 08 23:50:57 user nova-compute[72405]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.
Aug 08 23:50:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233c07b-a541-428b-aa45-0ff27a77f4dd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== disconnect_volume: return (348ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Deleting instance files /opt/stack/data/nova/instances/696fb05d-9eda-44c3-b067-e7c0852aa8a9_del
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Deletion of /opt/stack/data/nova/instances/696fb05d-9eda-44c3-b067-e7c0852aa8a9_del complete
Aug 08 23:50:57 user nova-compute[72405]: INFO nova.compute.manager [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Took 1.56 seconds to destroy the instance on the hypervisor.
Aug 08 23:50:57 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:50:57 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:58 user nova-compute[72405]: WARNING nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received unexpected event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with vm_state active and task_state deleting.
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-vif-unplugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] No waiting events found dispatching network-vif-unplugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-vif-unplugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Acquiring lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] No waiting events found dispatching network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:58 user nova-compute[72405]: WARNING nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received unexpected event network-vif-plugged-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a for instance with vm_state active and task_state deleting.
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:58 user nova-compute[72405]: WARNING nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received unexpected event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with vm_state active and task_state deleting.
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:58 user nova-compute[72405]: WARNING nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received unexpected event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with vm_state active and task_state deleting.
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-unplugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-unplugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:50:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-27cc5818-38b2-46c8-86ed-a01c052b4627 req-4b103188-1969-4926-8013-0a429ea4cd12 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-unplugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:50:59 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Took 1.67 seconds to deallocate network for instance.
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-165e77d5-7d84-41e5-a20f-18bcb170f975 req-95bc4e24-adb0-449f-a5d7-351d9501ebfd service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-deleted-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:50:59 user nova-compute[72405]: INFO nova.compute.manager [req-165e77d5-7d84-41e5-a20f-18bcb170f975 req-95bc4e24-adb0-449f-a5d7-351d9501ebfd service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Neutron deleted interface f5ad7ceb-586f-46af-9461-a31ff59bf87e; detaching it from the instance and deleting it from the info cache
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-165e77d5-7d84-41e5-a20f-18bcb170f975 req-95bc4e24-adb0-449f-a5d7-351d9501ebfd service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-165e77d5-7d84-41e5-a20f-18bcb170f975 req-95bc4e24-adb0-449f-a5d7-351d9501ebfd service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Detach interface failed, port_id=f5ad7ceb-586f-46af-9461-a31ff59bf87e, reason: Instance 482d453c-fbe5-4f41-8454-e290767220ed could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:50:59 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Took 1.53 seconds to deallocate network for instance.
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:59 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Deleted allocations for instance 482d453c-fbe5-4f41-8454-e290767220ed
Aug 08 23:50:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-512ec99d-efb4-4dbe-87f5-3e67b7d77ba0 tempest-SnapshotDataIntegrityTests-794286815 tempest-SnapshotDataIntegrityTests-794286815-project-member] Lock "482d453c-fbe5-4f41-8454-e290767220ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.403s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:50:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:00 user nova-compute[72405]: INFO nova.compute.manager [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Took 0.87 seconds to detach 1 volumes for instance.
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:00 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Deleted allocations for instance 696fb05d-9eda-44c3-b067-e7c0852aa8a9
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-62ddd71d-2286-4da2-9bad-97ea217e1593 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "696fb05d-9eda-44c3-b067-e7c0852aa8a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.336s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG nova.compute.manager [req-790e604a-3c6e-4d85-8da5-cfcc427a5a8e req-81b88b65-0459-4b11-8125-f0a0f1f99439 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-790e604a-3c6e-4d85-8da5-cfcc427a5a8e req-81b88b65-0459-4b11-8125-f0a0f1f99439 service nova] Acquiring lock "482d453c-fbe5-4f41-8454-e290767220ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-790e604a-3c6e-4d85-8da5-cfcc427a5a8e req-81b88b65-0459-4b11-8125-f0a0f1f99439 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-790e604a-3c6e-4d85-8da5-cfcc427a5a8e req-81b88b65-0459-4b11-8125-f0a0f1f99439 service nova] Lock "482d453c-fbe5-4f41-8454-e290767220ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:00 user nova-compute[72405]: DEBUG nova.compute.manager [req-790e604a-3c6e-4d85-8da5-cfcc427a5a8e req-81b88b65-0459-4b11-8125-f0a0f1f99439 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] No waiting events found dispatching network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:51:00 user nova-compute[72405]: WARNING nova.compute.manager [req-790e604a-3c6e-4d85-8da5-cfcc427a5a8e req-81b88b65-0459-4b11-8125-f0a0f1f99439 service nova] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Received unexpected event network-vif-plugged-f5ad7ceb-586f-46af-9461-a31ff59bf87e for instance with vm_state deleted and task_state None.
Aug 08 23:51:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-6551c632-9a6a-4cdc-869b-2c389acfeaa3 req-5884001c-f108-4b94-9602-2351bf1baf31 service nova] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Received event network-vif-deleted-edd4dd3f-7448-4cfe-95d7-7b5172f5bf8a {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:51:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538657.2184536, 482d453c-fbe5-4f41-8454-e290767220ed => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:51:12 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] VM Stopped (Lifecycle Event)
Aug 08 23:51:12 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538657.2233734, 696fb05d-9eda-44c3-b067-e7c0852aa8a9 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:51:12 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] VM Stopped (Lifecycle Event)
Aug 08 23:51:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-277ddec9-94f7-4aac-96c2-6a0ce4771b33 None None] [instance: 482d453c-fbe5-4f41-8454-e290767220ed] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-1e97d996-2389-4d5c-a70c-03cd90645e27 None None] [instance: 696fb05d-9eda-44c3-b067-e7c0852aa8a9] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing instance network info cache due to event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updated VIF entry in instance network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG nova.network.neutron [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:51:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-29c78eca-77af-4c4b-afe9-b0edf5ee9c1d req-6c1ac1e3-f69c-41de-9467-418d332189c1 service nova] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing instance network info cache due to event network-changed-3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Refreshing network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:16 user nova-compute[72405]: INFO nova.compute.manager [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Detaching volume 9ed49423-63db-458b-8d87-48c975ab2033
Aug 08 23:51:16 user nova-compute[72405]: INFO nova.virt.block_device [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Attempting to driver detach volume 9ed49423-63db-458b-8d87-48c975ab2033 from mountpoint /dev/vdb
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Attempting to detach device vdb from instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:51:16 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:51:16 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:51:16 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:51:16 user nova-compute[72405]:   <serial>9ed49423-63db-458b-8d87-48c975ab2033</serial>
Aug 08 23:51:16 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:51:16 user nova-compute[72405]: </disk>
Aug 08 23:51:16 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:51:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully detached device vdb from instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f from the persistent domain config.
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:51:16 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:51:16 user nova-compute[72405]:   <source dev="/dev/sdd"/>
Aug 08 23:51:16 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:51:16 user nova-compute[72405]:   <serial>9ed49423-63db-458b-8d87-48c975ab2033</serial>
Aug 08 23:51:16 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:51:16 user nova-compute[72405]: </disk>
Aug 08 23:51:16 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updated VIF entry in instance network info cache for port 3cdd8eee-7983-4b19-be19-4b3cd582c137. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ebf04a27-4113-4df6-825f-71988fe77940 req-5529dc06-6aad-415c-ac61-59b1a6b1152f service nova] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:51:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538676.9972935, 5585ea20-9eb7-47c3-8b03-4c8253a7864f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:51:17 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully detached device vdb from instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f from the live domain config.
Aug 08 23:51:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CScKJewa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:51:17 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d78b551-d311-482a-b457-ec1539df49f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d442848-b5cf-4787-aee7-b42397ddce49]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:51:17 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:51:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:51:17 user nova-compute[72405]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 (non-flash)
Aug 08 23:51:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54e628c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033'): ({'sdd'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Removing single pathed devices sdd {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a88809-f52e-4af4-a349-91e1acbdfb57]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e542c8c0-7c64-4186-a148-ea3dee84e967]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Flushing IO for device /dev/sdd {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a248226-0cec-402c-9ec8-fe4dfc353196]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ed1e9-8771-4779-a347-abdc16f01b1b]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] SCSI volumes sdd have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fa485-9fb7-41a1-82e2-aab950703b33]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11be28-2572-43f2-9479-e27fd14003c6]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260]
Aug 08 23:51:17 user nova-compute[72405]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033, portal: 172.16.0.220,3260] successful.
Aug 08 23:51:17 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed49423-63db-458b-8d87-48c975ab2033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[df881047-c8c7-412a-88bd-7b38e82c743d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] <== disconnect_volume: return (251ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:17 user nova-compute[72405]: DEBUG nova.objects.instance [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'flavor' on Instance uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:51:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-92dc4123-7e6b-4321-9d71-420a56fe381c tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:51:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:51:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:51:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:51:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:51:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:46 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:51:48 user nova-compute[72405]: INFO nova.compute.claims [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Claim successful on node user
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:51:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:51:48 user nova-compute[72405]: INFO nova.virt.block_device [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Booting with volume 05a3a61b-8845-4b00-a80c-8b944cb4b289 at /dev/vda
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.policy [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246e22061eb47eda51b4b6634102922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc0496a99448ce8705555dc3ed9c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG os_brick.utils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[598e68b2-5eab-4968-abcf-b7d17803a103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e774f3-e4d5-4ed5-909c-e7cc3b34f7da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb4931-b667-4689-91e9-fcafbd317a42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0f8ac-cc62-4d7e-9ef0-0660ffaca709]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:51:48 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:51:48 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f12c04-3df1-4812-af0a-c1bd1e25e553]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG os_brick.utils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:51:48 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating existing volume attachment record: 2a749d83-345f-4c33-8798-e4c6a3178f98 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Successfully created port: c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Successfully updated port: c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquired lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-changed-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Refreshing instance network info cache due to event network-changed-c66afa09-c963-46de-9023-e77b0ab12e8c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] Acquiring lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:51:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG nova.network.neutron [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Releasing lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Instance network_info: |[{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] Acquired lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Refreshing network info cache for port c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updated VIF entry in instance network info cache for port c66afa09-c963-46de-9023-e77b0ab12e8c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9a729f33-e9f7-4853-8ee4-243c4e42645c req-2d97685f-b422-4e68-b149-1fead95d2e65 service nova] Releasing lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:51:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:51:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:51:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:51:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [{"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-5585ea20-9eb7-47c3-8b03-4c8253a7864f" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:51:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:55 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:51:56 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Creating image(s)
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed8a421-ad31-4a0e-884e-89021dbd5b27/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Start _get_guest_xml network_info=[{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2a749d83-345f-4c33-8798-e4c6a3178f98', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ed8a421-ad31-4a0e-884e-89021dbd5b27', 'attached_at': '', 'detached_at': '', 'volume_id': '05a3a61b-8845-4b00-a80c-8b944cb4b289', 'serial': '05a3a61b-8845-4b00-a80c-8b944cb4b289'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:51:56 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:51:56 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:51:56 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:51:56 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:51:56 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8afb540-e96b-436c-9f30-16c750765ed7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:51:56 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25eef4c-8847-4f05-ac2f-2bc6acece730]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289] added
Aug 08 23:51:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b12cd2-6719-4558-a327-f98e603615e3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4753a-4714-4562-9273-4ed9a3e0280c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdfIFvKm {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdfIFvKm" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[163f846a-f931-4198-ae4d-f454c68cb3c6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdfIFvKm'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdd65da-51c5-4b9a-91cc-2d67b6a7b0c6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd2cff5-12d0-4549-9774-8427a7b2da5a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:51:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:51:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5d3769-726d-467f-9d67-a2e31b4c73a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]
Aug 08 23:51:57 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.
Aug 08 23:51:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d2379-f6db-4594-9271-736df4cdc77e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[403332b0-6188-44e1-97ee-10835a4d9837]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:51:57 user nova-compute[72405]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:51:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:51:57 user nova-compute[72405]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:51:57 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b337a8df-59bb-4d9b-a189-3e760a1224bd]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:57 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:51:57 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8348MB free_disk=25.147945404052734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0ed8a421-ad31-4a0e-884e-89021dbd5b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:51:57 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23438326637656435', 'path': '/dev/sdc'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438326637656435', 'path': '/dev/sdc'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1511778438',display_name='tempest-TestVolumeBootPattern-server-1511778438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1511778438',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-z15p42gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:51:48Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=0ed8a421-ad31-4a0e-884e-89021dbd5b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.objects.instance [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed8a421-ad31-4a0e-884e-89021dbd5b27 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:51:58 user nova-compute[72405]:   <uuid>0ed8a421-ad31-4a0e-884e-89021dbd5b27</uuid>
Aug 08 23:51:58 user nova-compute[72405]:   <name>instance-0000002f</name>
Aug 08 23:51:58 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:51:58 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:51:58 user nova-compute[72405]:   <metadata>
Aug 08 23:51:58 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:51:58 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:51:58 user nova-compute[72405]:       <nova:name>tempest-TestVolumeBootPattern-server-1511778438</nova:name>
Aug 08 23:51:58 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:51:56</nova:creationTime>
Aug 08 23:51:58 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:51:58 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:51:58 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:51:58 user nova-compute[72405]:       <nova:owner>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:user uuid="a246e22061eb47eda51b4b6634102922">tempest-TestVolumeBootPattern-1873778230-project-member</nova:user>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:project uuid="bffc0496a99448ce8705555dc3ed9c45">tempest-TestVolumeBootPattern-1873778230</nova:project>
Aug 08 23:51:58 user nova-compute[72405]:       </nova:owner>
Aug 08 23:51:58 user nova-compute[72405]:       <nova:ports>
Aug 08 23:51:58 user nova-compute[72405]:         <nova:port uuid="c66afa09-c963-46de-9023-e77b0ab12e8c">
Aug 08 23:51:58 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 08 23:51:58 user nova-compute[72405]:         </nova:port>
Aug 08 23:51:58 user nova-compute[72405]:       </nova:ports>
Aug 08 23:51:58 user nova-compute[72405]:     </nova:instance>
Aug 08 23:51:58 user nova-compute[72405]:   </metadata>
Aug 08 23:51:58 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:51:58 user nova-compute[72405]:     <system>
Aug 08 23:51:58 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:51:58 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:51:58 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:51:58 user nova-compute[72405]:       <entry name="serial">0ed8a421-ad31-4a0e-884e-89021dbd5b27</entry>
Aug 08 23:51:58 user nova-compute[72405]:       <entry name="uuid">0ed8a421-ad31-4a0e-884e-89021dbd5b27</entry>
Aug 08 23:51:58 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:51:58 user nova-compute[72405]:     </system>
Aug 08 23:51:58 user nova-compute[72405]:   </sysinfo>
Aug 08 23:51:58 user nova-compute[72405]:   <os>
Aug 08 23:51:58 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:51:58 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:51:58 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:51:58 user nova-compute[72405]:   </os>
Aug 08 23:51:58 user nova-compute[72405]:   <features>
Aug 08 23:51:58 user nova-compute[72405]:     <acpi/>
Aug 08 23:51:58 user nova-compute[72405]:     <apic/>
Aug 08 23:51:58 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:51:58 user nova-compute[72405]:   </features>
Aug 08 23:51:58 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:51:58 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:51:58 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:51:58 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:51:58 user nova-compute[72405]:   </clock>
Aug 08 23:51:58 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:51:58 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:51:58 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:51:58 user nova-compute[72405]:   </cpu>
Aug 08 23:51:58 user nova-compute[72405]:   <devices>
Aug 08 23:51:58 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:51:58 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:51:58 user nova-compute[72405]:       <source dev="/dev/sdc"/>
Aug 08 23:51:58 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:51:58 user nova-compute[72405]:       <serial>05a3a61b-8845-4b00-a80c-8b944cb4b289</serial>
Aug 08 23:51:58 user nova-compute[72405]:     </disk>
Aug 08 23:51:58 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:51:58 user nova-compute[72405]:       <mac address="fa:16:3e:26:cd:01"/>
Aug 08 23:51:58 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:51:58 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:51:58 user nova-compute[72405]:       <target dev="tapc66afa09-c9"/>
Aug 08 23:51:58 user nova-compute[72405]:     </interface>
Aug 08 23:51:58 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:51:58 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/0ed8a421-ad31-4a0e-884e-89021dbd5b27/console.log" append="off"/>
Aug 08 23:51:58 user nova-compute[72405]:     </serial>
Aug 08 23:51:58 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:51:58 user nova-compute[72405]:     <video>
Aug 08 23:51:58 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:51:58 user nova-compute[72405]:     </video>
Aug 08 23:51:58 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:51:58 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:51:58 user nova-compute[72405]:     </rng>
Aug 08 23:51:58 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:51:58 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:51:58 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:51:58 user nova-compute[72405]:     </memballoon>
Aug 08 23:51:58 user nova-compute[72405]:   </devices>
Aug 08 23:51:58 user nova-compute[72405]: </domain>
Aug 08 23:51:58 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1511778438',display_name='tempest-TestVolumeBootPattern-server-1511778438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1511778438',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-z15p42gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:51:48Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=0ed8a421-ad31-4a0e-884e-89021dbd5b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG os_vif [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66afa09-c9, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc66afa09-c9, col_values=(('external_ids', {'iface-id': 'c66afa09-c963-46de-9023-e77b0ab12e8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:cd:01', 'vm-uuid': '0ed8a421-ad31-4a0e-884e-89021dbd5b27'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:58 user nova-compute[72405]: INFO os_vif [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9')
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:51:58 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No VIF found with MAC fa:16:3e:26:cd:01, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-17c09a5b-2c15-42fa-be33-c1a22b6fa437 req-f3600e28-beaf-423c-8a8e-b1ab00b58289 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-17c09a5b-2c15-42fa-be33-c1a22b6fa437 req-f3600e28-beaf-423c-8a8e-b1ab00b58289 service nova] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-17c09a5b-2c15-42fa-be33-c1a22b6fa437 req-f3600e28-beaf-423c-8a8e-b1ab00b58289 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-17c09a5b-2c15-42fa-be33-c1a22b6fa437 req-f3600e28-beaf-423c-8a8e-b1ab00b58289 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:51:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-17c09a5b-2c15-42fa-be33-c1a22b6fa437 req-f3600e28-beaf-423c-8a8e-b1ab00b58289 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] No waiting events found dispatching network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:51:59 user nova-compute[72405]: WARNING nova.compute.manager [req-17c09a5b-2c15-42fa-be33-c1a22b6fa437 req-f3600e28-beaf-423c-8a8e-b1ab00b58289 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received unexpected event network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c for instance with vm_state building and task_state spawning.
Aug 08 23:52:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538721.6761508, 0ed8a421-ad31-4a0e-884e-89021dbd5b27 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] VM Resumed (Lifecycle Event)
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Instance spawned successfully.
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538721.6774876, 0ed8a421-ad31-4a0e-884e-89021dbd5b27 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] VM Started (Lifecycle Event)
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-fb88da0f-d157-49a3-b26a-a6d3bc469a4f req-4a9b0959-d2dc-4d55-9a01-18a8b443dbd4 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fb88da0f-d157-49a3-b26a-a6d3bc469a4f req-4a9b0959-d2dc-4d55-9a01-18a8b443dbd4 service nova] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fb88da0f-d157-49a3-b26a-a6d3bc469a4f req-4a9b0959-d2dc-4d55-9a01-18a8b443dbd4 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fb88da0f-d157-49a3-b26a-a6d3bc469a4f req-4a9b0959-d2dc-4d55-9a01-18a8b443dbd4 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [req-fb88da0f-d157-49a3-b26a-a6d3bc469a4f req-4a9b0959-d2dc-4d55-9a01-18a8b443dbd4 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] No waiting events found dispatching network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:52:01 user nova-compute[72405]: WARNING nova.compute.manager [req-fb88da0f-d157-49a3-b26a-a6d3bc469a4f req-4a9b0959-d2dc-4d55-9a01-18a8b443dbd4 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received unexpected event network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c for instance with vm_state building and task_state spawning.
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 08 23:52:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:52:01 user nova-compute[72405]: INFO nova.compute.manager [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Took 13.86 seconds to build instance.
Aug 08 23:52:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-3bde5b8c-a763-469c-97d7-294d2e85da4c tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.971s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:12 user nova-compute[72405]: INFO nova.compute.manager [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Terminating instance
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6435d35-f875-4436-82bb-ab2d24786119 req-f776ed79-42cc-41d6-8b18-9fb00ca928ec service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-unplugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6435d35-f875-4436-82bb-ab2d24786119 req-f776ed79-42cc-41d6-8b18-9fb00ca928ec service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6435d35-f875-4436-82bb-ab2d24786119 req-f776ed79-42cc-41d6-8b18-9fb00ca928ec service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a6435d35-f875-4436-82bb-ab2d24786119 req-f776ed79-42cc-41d6-8b18-9fb00ca928ec service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6435d35-f875-4436-82bb-ab2d24786119 req-f776ed79-42cc-41d6-8b18-9fb00ca928ec service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-unplugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-a6435d35-f875-4436-82bb-ab2d24786119 req-f776ed79-42cc-41d6-8b18-9fb00ca928ec service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-unplugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Instance destroyed successfully.
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lazy-loading 'resources' on Instance uuid 5585ea20-9eb7-47c3-8b03-4c8253a7864f {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1804512516',display_name='tempest-TestMinimumBasicScenario-server-1804512516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1804512516',id=45,image_ref='976795a8-ee84-4937-bc5c-3653607c32ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2UAG5yelSLvIfS59350v1RSArQdSW7tPkN626uaJT2OBFFEjLXLm2SYZURQMuMk9tI3WPGfTmlQILFxkehPj53baXkFJ/ADqHiAzd47bk+IeU40KfsCUOZtkqb7tqt8w==',key_name='tempest-TestMinimumBasicScenario-1136501143',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd2fb572f9cd475e91d08e349f2b1320',ramdisk_id='',reservation_id='r-ztu44t86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='976795a8-ee84-4937-bc5c-3653607c32ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-511149043',owner_user_name='tempest-TestMinimumBasicScenario-511149043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:49:31Z,user_data=None,user_id='13ba98961cad44b0a1246d7d7aaf1e9a',uuid=5585ea20-9eb7-47c3-8b03-4c8253a7864f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converting VIF {"id": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "address": "fa:16:3e:7b:d7:11", "network": {"id": "be9e0c69-ffd2-44a2-b729-1fedc7db59b5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-581347258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2fb572f9cd475e91d08e349f2b1320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cdd8eee-79", "ovs_interfaceid": "3cdd8eee-7983-4b19-be19-4b3cd582c137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG os_vif [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cdd8eee-79, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:52:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:12 user nova-compute[72405]: INFO os_vif [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:11,bridge_name='br-int',has_traffic_filtering=True,id=3cdd8eee-7983-4b19-be19-4b3cd582c137,network=Network(be9e0c69-ffd2-44a2-b729-1fedc7db59b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cdd8eee-79')
Aug 08 23:52:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Deleting instance files /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f_del
Aug 08 23:52:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Deletion of /opt/stack/data/nova/instances/5585ea20-9eb7-47c3-8b03-4c8253a7864f_del complete
Aug 08 23:52:13 user nova-compute[72405]: INFO nova.compute.manager [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 08 23:52:13 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:13 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:52:13 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Took 0.99 seconds to deallocate network for instance.
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-1af0dc18-2010-4763-afaf-fe69c190c2a8 req-6557ab85-cfb2-4959-a0d4-3eeaaa9bc2d3 service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-deleted-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:14 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Deleted allocations for instance 5585ea20-9eb7-47c3-8b03-4c8253a7864f
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-567493a4-9aa5-4d8f-b7dd-b77fbca56fc0 tempest-TestMinimumBasicScenario-511149043 tempest-TestMinimumBasicScenario-511149043-project-member] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:52:14 user nova-compute[72405]: WARNING nova.compute.manager [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state deleted and task_state None.
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] Acquiring lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] Lock "5585ea20-9eb7-47c3-8b03-4c8253a7864f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] No waiting events found dispatching network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:52:14 user nova-compute[72405]: WARNING nova.compute.manager [req-726743e9-b316-4ef4-8309-f2c91077d876 req-9d6c9bd9-e761-4673-bda6-e6a3f0a7b2bf service nova] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Received unexpected event network-vif-plugged-3cdd8eee-7983-4b19-be19-4b3cd582c137 for instance with vm_state deleted and task_state None.
Aug 08 23:52:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:23 user nova-compute[72405]: DEBUG nova.compute.manager [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing instance network info cache due to event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:52:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:52:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:52:23 user nova-compute[72405]: DEBUG nova.network.neutron [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updated VIF entry in instance network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.network.neutron [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:52:24 user nova-compute[72405]: INFO nova.compute.manager [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Detaching volume d89b0a33-69ad-42c1-b4f8-de0fdbe3e627
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7cc53c04-25e4-48c4-85b0-a54edfa47334 req-c0c4529b-0825-4761-991f-2408427a39b5 service nova] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:52:24 user nova-compute[72405]: INFO nova.virt.block_device [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Attempting to driver detach volume d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 from mountpoint /dev/vdb
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Attempting to detach device vdb from instance d46f8020-b843-442b-b6f9-709536a8d419 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:52:24 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:52:24 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:52:24 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:52:24 user nova-compute[72405]:   <serial>d89b0a33-69ad-42c1-b4f8-de0fdbe3e627</serial>
Aug 08 23:52:24 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:52:24 user nova-compute[72405]: </disk>
Aug 08 23:52:24 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:52:24 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully detached device vdb from instance d46f8020-b843-442b-b6f9-709536a8d419 from the persistent domain config.
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d46f8020-b843-442b-b6f9-709536a8d419 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:52:24 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:52:24 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:52:24 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:52:24 user nova-compute[72405]:   <serial>d89b0a33-69ad-42c1-b4f8-de0fdbe3e627</serial>
Aug 08 23:52:24 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:52:24 user nova-compute[72405]: </disk>
Aug 08 23:52:24 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691538744.918195, d46f8020-b843-442b-b6f9-709536a8d419 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:52:24 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully detached device vdb from instance d46f8020-b843-442b-b6f9-709536a8d419 from the live domain config.
Aug 08 23:52:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsAYgohj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:52:24 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d77cb-5832-4def-87f9-1ad4aec9b4c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a4ee0-8d5c-4ca8-b745-a54e5003da07]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:52:24 user nova-compute[72405]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:52:24 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 (non-flash)
Aug 08 23:52:24 user nova-compute[72405]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:52:24 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7c160e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:52:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c447a37e-8f31-4563-8215-003d37aa05c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35050c9-183d-480b-a131-c6b087ceea49]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8783ac4-0a34-40c6-8e44-e8d44a56ab93]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb29a92c-dd48-4627-9c3d-6cd488af4904]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4359874-2384-40e0-84c6-6237c461ed10]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7f4255-fe51-4a6b-af50-65adf3d867d7]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260]
Aug 08 23:52:25 user nova-compute[72405]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627, portal: 172.16.0.220,3260] successful.
Aug 08 23:52:25 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89b0a33-69ad-42c1-b4f8-de0fdbe3e627 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28abd8-3d11-4d0d-b373-3275a1f9a68a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] <== disconnect_volume: return (280ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG nova.compute.manager [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing instance network info cache due to event network-changed-d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] Acquiring lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] Acquired lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG nova.network.neutron [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Refreshing network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG nova.objects.instance [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'flavor' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:52:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-1c5e2986-2494-4e75-9f70-32994c5ffe23 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.718s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:26 user nova-compute[72405]: DEBUG nova.network.neutron [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updated VIF entry in instance network info cache for port d3da762d-06c5-455d-bd9e-ae602fdd4c0c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:52:26 user nova-compute[72405]: DEBUG nova.network.neutron [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [{"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:52:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-4f271e8a-e623-4794-abf9-18cb1fe4cb9c req-8988c262-2a5d-4b8f-9456-dd867e0dd793 service nova] Releasing lock "refresh_cache-d46f8020-b843-442b-b6f9-709536a8d419" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:52:27 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538732.8861604, 5585ea20-9eb7-47c3-8b03-4c8253a7864f => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:52:27 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] VM Stopped (Lifecycle Event)
Aug 08 23:52:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-060556d8-4582-436a-abe9-f72b878ac3ab None None] [instance: 5585ea20-9eb7-47c3-8b03-4c8253a7864f] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:52:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:47 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:50 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:52:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:53 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [{"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:52:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-04f2ae79-2d01-4a28-888c-93b50bc61a07" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:52:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:52:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:52:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:52:57 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:52:58 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:52:58 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=25.166255950927734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance d46f8020-b843-442b-b6f9-709536a8d419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0ed8a421-ad31-4a0e-884e-89021dbd5b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:52:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:53:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:14 user nova-compute[72405]: INFO nova.compute.manager [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Terminating instance
Aug 08 23:53:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-159adfef-419d-4e88-bc29-7716de39d15a req-d2768b4f-78e5-4108-88a2-f4dd1f3802a6 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-159adfef-419d-4e88-bc29-7716de39d15a req-d2768b4f-78e5-4108-88a2-f4dd1f3802a6 service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-159adfef-419d-4e88-bc29-7716de39d15a req-d2768b4f-78e5-4108-88a2-f4dd1f3802a6 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-159adfef-419d-4e88-bc29-7716de39d15a req-d2768b4f-78e5-4108-88a2-f4dd1f3802a6 service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-159adfef-419d-4e88-bc29-7716de39d15a req-d2768b4f-78e5-4108-88a2-f4dd1f3802a6 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG nova.compute.manager [req-159adfef-419d-4e88-bc29-7716de39d15a req-d2768b4f-78e5-4108-88a2-f4dd1f3802a6 service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-unplugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Instance destroyed successfully.
Aug 08 23:53:15 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'resources' on Instance uuid d46f8020-b843-442b-b6f9-709536a8d419 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1411537504',display_name='tempest-ServerRescueNegativeTestJSON-server-1411537504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1411537504',id=44,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjtq0R9wy//PGrzT3CMMKz4cOXoiolU4oLvX9Mp/t7B/3mI/kAnGdMQpmpkbjvaJKMt1IXTTdtbpdJz0DnIpZ5gla+qPOVGx+RgCGzgfyhZ8Xh45ie8NWT+Kps1hgoYPA==',key_name='tempest-keypair-1596600579',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-wfp2grvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=d46f8020-b843-442b-b6f9-709536a8d419,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "address": "fa:16:3e:d1:5d:44", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3da762d-06", "ovs_interfaceid": "d3da762d-06c5-455d-bd9e-ae602fdd4c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG os_vif [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3da762d-06, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:53:15 user nova-compute[72405]: INFO os_vif [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:5d:44,bridge_name='br-int',has_traffic_filtering=True,id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3da762d-06')
Aug 08 23:53:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Deleting instance files /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419_del
Aug 08 23:53:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Deletion of /opt/stack/data/nova/instances/d46f8020-b843-442b-b6f9-709536a8d419_del complete
Aug 08 23:53:15 user nova-compute[72405]: INFO nova.compute.manager [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 08 23:53:15 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:53:15 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:53:16 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Took 0.85 seconds to deallocate network for instance.
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-ae59c8d6-0443-4fe4-8c8c-c29b9896b1cf req-cf7d0988-fb9b-4655-a36a-62d3ec529f3b service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-deleted-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:53:16 user nova-compute[72405]: INFO nova.compute.manager [req-ae59c8d6-0443-4fe4-8c8c-c29b9896b1cf req-cf7d0988-fb9b-4655-a36a-62d3ec529f3b service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Neutron deleted interface d3da762d-06c5-455d-bd9e-ae602fdd4c0c; detaching it from the instance and deleting it from the info cache
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.network.neutron [req-ae59c8d6-0443-4fe4-8c8c-c29b9896b1cf req-cf7d0988-fb9b-4655-a36a-62d3ec529f3b service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-ae59c8d6-0443-4fe4-8c8c-c29b9896b1cf req-cf7d0988-fb9b-4655-a36a-62d3ec529f3b service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Detach interface failed, port_id=d3da762d-06c5-455d-bd9e-ae602fdd4c0c, reason: Instance d46f8020-b843-442b-b6f9-709536a8d419 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:16 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Deleted allocations for instance d46f8020-b843-442b-b6f9-709536a8d419
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a416a403-7777-4baa-a8e0-9d909bb2f8c3 tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "d46f8020-b843-442b-b6f9-709536a8d419" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-a0fecc10-c8b1-4950-a66d-715245e19f17 req-b89fa4aa-15f3-42d1-82cb-ed46cf531c4a service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a0fecc10-c8b1-4950-a66d-715245e19f17 req-b89fa4aa-15f3-42d1-82cb-ed46cf531c4a service nova] Acquiring lock "d46f8020-b843-442b-b6f9-709536a8d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a0fecc10-c8b1-4950-a66d-715245e19f17 req-b89fa4aa-15f3-42d1-82cb-ed46cf531c4a service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-a0fecc10-c8b1-4950-a66d-715245e19f17 req-b89fa4aa-15f3-42d1-82cb-ed46cf531c4a service nova] Lock "d46f8020-b843-442b-b6f9-709536a8d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:16 user nova-compute[72405]: DEBUG nova.compute.manager [req-a0fecc10-c8b1-4950-a66d-715245e19f17 req-b89fa4aa-15f3-42d1-82cb-ed46cf531c4a service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] No waiting events found dispatching network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:53:16 user nova-compute[72405]: WARNING nova.compute.manager [req-a0fecc10-c8b1-4950-a66d-715245e19f17 req-b89fa4aa-15f3-42d1-82cb-ed46cf531c4a service nova] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Received unexpected event network-vif-plugged-d3da762d-06c5-455d-bd9e-ae602fdd4c0c for instance with vm_state deleted and task_state None.
Aug 08 23:53:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:30 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538795.413132, d46f8020-b843-442b-b6f9-709536a8d419 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:53:30 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: d46f8020-b843-442b-b6f9-709536a8d419] VM Stopped (Lifecycle Event)
Aug 08 23:53:30 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c1fe48e4-5bea-47af-88d5-4358851827ac None None] [instance: d46f8020-b843-442b-b6f9-709536a8d419] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:53:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-changed-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:53:39 user nova-compute[72405]: DEBUG nova.compute.manager [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Refreshing instance network info cache due to event network-changed-c66afa09-c963-46de-9023-e77b0ab12e8c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:53:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] Acquiring lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:53:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] Acquired lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:53:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Refreshing network info cache for port c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:53:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updated VIF entry in instance network info cache for port c66afa09-c963-46de-9023-e77b0ab12e8c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:53:40 user nova-compute[72405]: DEBUG nova.network.neutron [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:53:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e6c8a6a7-8ee4-45e6-8a20-16a066335c1c req-89e9db6c-b221-4adf-897f-87172a3f7acb service nova] Releasing lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:53:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:44 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:53:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:53:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "af42d55e-79ca-489e-a616-cc0387f6d853" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:53:51 user nova-compute[72405]: INFO nova.compute.claims [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Claim successful on node user
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.network.neutron [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:53:51 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:53:51 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:53:51 user nova-compute[72405]: INFO nova.virt.block_device [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Booting with volume 54961877-cc78-49ce-aa3a-7eb685a27c9e at /dev/vda
Aug 08 23:53:52 user nova-compute[72405]: DEBUG nova.policy [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246e22061eb47eda51b4b6634102922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc0496a99448ce8705555dc3ed9c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG os_brick.utils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff259d5-2ec2-4723-80fa-b92a0bbf8218]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ecf1d3-bc81-4c6d-94ee-f012a4e89e7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab05a57-fbe9-462a-af87-e83de95d393a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a1626-1b53-4f39-b17c-3bb288b6bccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:53:52 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2cbf8d-6051-4cee-a164-34334eaf7a83]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG os_brick.utils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating existing volume attachment record: faa6a75c-37d5-4a9a-b204-6e03234553f8 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Successfully created port: 41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:53:52 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [{"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-74c3a8fc-fff0-422f-8583-142d7911e603" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:53:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Successfully updated port: 41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquired lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-changed-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.compute.manager [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Refreshing instance network info cache due to event network-changed-41b4bd08-1292-41a1-b966-3075d0b9dd76. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] Acquiring lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating instance_info_cache with network_info: [{"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Releasing lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Instance network_info: |[{"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] Acquired lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Refreshing network info cache for port 41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updated VIF entry in instance network info cache for port 41b4bd08-1292-41a1-b966-3075d0b9dd76. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG nova.network.neutron [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating instance_info_cache with network_info: [{"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-67ae4a1b-9bd5-410b-8b19-28f22722b6a5 req-268c3ea7-1741-44bc-8c50-144d3a1f50d2 service nova] Releasing lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:53:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:53:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:53:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:58 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:53:59 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:53:59 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:53:59 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.232410430908203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:53:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 74c3a8fc-fff0-422f-8583-142d7911e603 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0ed8a421-ad31-4a0e-884e-89021dbd5b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance af42d55e-79ca-489e-a616-cc0387f6d853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:54:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:54:05 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Creating image(s)
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Did not create local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Ensure instance console log exists: /opt/stack/data/nova/instances/af42d55e-79ca-489e-a616-cc0387f6d853/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Start _get_guest_xml network_info=[{"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'faa6a75c-37d5-4a9a-b204-6e03234553f8', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTHGYUbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af42d55e-79ca-489e-a616-cc0387f6d853', 'attached_at': '', 'detached_at': '', 'volume_id': '54961877-cc78-49ce-aa3a-7eb685a27c9e', 'serial': '54961877-cc78-49ce-aa3a-7eb685a27c9e'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:54:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:54:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTHGYUbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:54:05 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:54:05 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:54:05 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56650f6-c75e-4cab-9c39-81c5597ad9e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:54:05 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa45a0f-763f-46a3-8e05-c53f219d4814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e] added
Aug 08 23:54:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[89922e8c-36a5-497c-bde2-3e8963b0ff40]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec71df-8b98-4bc4-a0c6-c2dc0826a30a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTHGYUbS {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTHGYUbS" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26abcd-5756-4900-9208-b2ccfb3e01f5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTHGYUbS'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca4e316-767b-4845-9ad8-38c2eca76b27]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b65a1de-feb4-4c3c-a760-9dd9af8fc664]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:54:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:54:05 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --login" returned: 0 in 1.052s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3248c5d2-1ae5-4182-abe8-7e59e9d7f0fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260]
Aug 08 23:54:06 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260] successful.
Aug 08 23:54:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce3d4b-73d3-4dcf-91b5-7b2250e8bd6e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a38744-f12b-4cc7-a3f6-307be236a462]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:54:06 user nova-compute[72405]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e (non-flash)
Aug 08 23:54:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:54:06 user nova-compute[72405]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e (non-flash)
Aug 08 23:54:06 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.271s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79edb93-1dad-4707-960f-5352c774e048]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:54:06 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTHGYUbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.302s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== connect_volume: return (2304ms) {'type': 'block', 'scsi_wwn': '23864663862343136', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864663862343136', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-91302134',display_name='tempest-TestVolumeBootPattern-server-91302134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-91302134',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-uvlk159b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:53:52Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=af42d55e-79ca-489e-a616-cc0387f6d853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'pci_devices' on Instance uuid af42d55e-79ca-489e-a616-cc0387f6d853 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:54:07 user nova-compute[72405]:   <uuid>af42d55e-79ca-489e-a616-cc0387f6d853</uuid>
Aug 08 23:54:07 user nova-compute[72405]:   <name>instance-00000030</name>
Aug 08 23:54:07 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:54:07 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:54:07 user nova-compute[72405]:   <metadata>
Aug 08 23:54:07 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:54:07 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:54:07 user nova-compute[72405]:       <nova:name>tempest-TestVolumeBootPattern-server-91302134</nova:name>
Aug 08 23:54:07 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:54:05</nova:creationTime>
Aug 08 23:54:07 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:54:07 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:54:07 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:54:07 user nova-compute[72405]:       <nova:owner>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:user uuid="a246e22061eb47eda51b4b6634102922">tempest-TestVolumeBootPattern-1873778230-project-member</nova:user>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:project uuid="bffc0496a99448ce8705555dc3ed9c45">tempest-TestVolumeBootPattern-1873778230</nova:project>
Aug 08 23:54:07 user nova-compute[72405]:       </nova:owner>
Aug 08 23:54:07 user nova-compute[72405]:       <nova:ports>
Aug 08 23:54:07 user nova-compute[72405]:         <nova:port uuid="41b4bd08-1292-41a1-b966-3075d0b9dd76">
Aug 08 23:54:07 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:54:07 user nova-compute[72405]:         </nova:port>
Aug 08 23:54:07 user nova-compute[72405]:       </nova:ports>
Aug 08 23:54:07 user nova-compute[72405]:     </nova:instance>
Aug 08 23:54:07 user nova-compute[72405]:   </metadata>
Aug 08 23:54:07 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:54:07 user nova-compute[72405]:     <system>
Aug 08 23:54:07 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:54:07 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:54:07 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:54:07 user nova-compute[72405]:       <entry name="serial">af42d55e-79ca-489e-a616-cc0387f6d853</entry>
Aug 08 23:54:07 user nova-compute[72405]:       <entry name="uuid">af42d55e-79ca-489e-a616-cc0387f6d853</entry>
Aug 08 23:54:07 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:54:07 user nova-compute[72405]:     </system>
Aug 08 23:54:07 user nova-compute[72405]:   </sysinfo>
Aug 08 23:54:07 user nova-compute[72405]:   <os>
Aug 08 23:54:07 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:54:07 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:54:07 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:54:07 user nova-compute[72405]:   </os>
Aug 08 23:54:07 user nova-compute[72405]:   <features>
Aug 08 23:54:07 user nova-compute[72405]:     <acpi/>
Aug 08 23:54:07 user nova-compute[72405]:     <apic/>
Aug 08 23:54:07 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:54:07 user nova-compute[72405]:   </features>
Aug 08 23:54:07 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:54:07 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:54:07 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:54:07 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:54:07 user nova-compute[72405]:   </clock>
Aug 08 23:54:07 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:54:07 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:54:07 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:54:07 user nova-compute[72405]:   </cpu>
Aug 08 23:54:07 user nova-compute[72405]:   <devices>
Aug 08 23:54:07 user nova-compute[72405]:     <disk type="block" device="disk">
Aug 08 23:54:07 user nova-compute[72405]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:54:07 user nova-compute[72405]:       <source dev="/dev/sdb"/>
Aug 08 23:54:07 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:54:07 user nova-compute[72405]:       <serial>54961877-cc78-49ce-aa3a-7eb685a27c9e</serial>
Aug 08 23:54:07 user nova-compute[72405]:     </disk>
Aug 08 23:54:07 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:54:07 user nova-compute[72405]:       <mac address="fa:16:3e:2c:98:c3"/>
Aug 08 23:54:07 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:54:07 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:54:07 user nova-compute[72405]:       <target dev="tap41b4bd08-12"/>
Aug 08 23:54:07 user nova-compute[72405]:     </interface>
Aug 08 23:54:07 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:54:07 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/af42d55e-79ca-489e-a616-cc0387f6d853/console.log" append="off"/>
Aug 08 23:54:07 user nova-compute[72405]:     </serial>
Aug 08 23:54:07 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:54:07 user nova-compute[72405]:     <video>
Aug 08 23:54:07 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:54:07 user nova-compute[72405]:     </video>
Aug 08 23:54:07 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:54:07 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:54:07 user nova-compute[72405]:     </rng>
Aug 08 23:54:07 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:54:07 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:54:07 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:54:07 user nova-compute[72405]:     </memballoon>
Aug 08 23:54:07 user nova-compute[72405]:   </devices>
Aug 08 23:54:07 user nova-compute[72405]: </domain>
Aug 08 23:54:07 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-91302134',display_name='tempest-TestVolumeBootPattern-server-91302134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-91302134',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-uvlk159b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:53:52Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=af42d55e-79ca-489e-a616-cc0387f6d853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG os_vif [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41b4bd08-12, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41b4bd08-12, col_values=(('external_ids', {'iface-id': '41b4bd08-1292-41a1-b966-3075d0b9dd76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:98:c3', 'vm-uuid': 'af42d55e-79ca-489e-a616-cc0387f6d853'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:07 user nova-compute[72405]: INFO os_vif [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12')
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:54:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] No VIF found with MAC fa:16:3e:2c:98:c3, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:54:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-d3affe3b-1f83-4a73-ac2c-519bb4c3ba4c req-67f26970-b09b-409f-adb9-68ac91a59f36 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:54:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d3affe3b-1f83-4a73-ac2c-519bb4c3ba4c req-67f26970-b09b-409f-adb9-68ac91a59f36 service nova] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d3affe3b-1f83-4a73-ac2c-519bb4c3ba4c req-67f26970-b09b-409f-adb9-68ac91a59f36 service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-d3affe3b-1f83-4a73-ac2c-519bb4c3ba4c req-67f26970-b09b-409f-adb9-68ac91a59f36 service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-d3affe3b-1f83-4a73-ac2c-519bb4c3ba4c req-67f26970-b09b-409f-adb9-68ac91a59f36 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] No waiting events found dispatching network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:54:09 user nova-compute[72405]: WARNING nova.compute.manager [req-d3affe3b-1f83-4a73-ac2c-519bb4c3ba4c req-67f26970-b09b-409f-adb9-68ac91a59f36 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received unexpected event network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 for instance with vm_state building and task_state spawning.
Aug 08 23:54:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538851.1359587, af42d55e-79ca-489e-a616-cc0387f6d853 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] VM Resumed (Lifecycle Event)
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Instance spawned successfully.
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691538851.1405547, af42d55e-79ca-489e-a616-cc0387f6d853 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] VM Started (Lifecycle Event)
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-3be48c73-08ca-49f0-a9e5-55bbd6c81634 req-c4252f7a-326a-46ee-8710-6aaa9f817dbe service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3be48c73-08ca-49f0-a9e5-55bbd6c81634 req-c4252f7a-326a-46ee-8710-6aaa9f817dbe service nova] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3be48c73-08ca-49f0-a9e5-55bbd6c81634 req-c4252f7a-326a-46ee-8710-6aaa9f817dbe service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3be48c73-08ca-49f0-a9e5-55bbd6c81634 req-c4252f7a-326a-46ee-8710-6aaa9f817dbe service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-3be48c73-08ca-49f0-a9e5-55bbd6c81634 req-c4252f7a-326a-46ee-8710-6aaa9f817dbe service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] No waiting events found dispatching network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:54:11 user nova-compute[72405]: WARNING nova.compute.manager [req-3be48c73-08ca-49f0-a9e5-55bbd6c81634 req-c4252f7a-326a-46ee-8710-6aaa9f817dbe service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received unexpected event network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 for instance with vm_state building and task_state spawning.
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 08 23:54:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:54:11 user nova-compute[72405]: INFO nova.compute.manager [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Took 19.79 seconds to build instance.
Aug 08 23:54:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-047b8e1b-9c4a-49b0-94ee-fc5019e0ee58 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "af42d55e-79ca-489e-a616-cc0387f6d853" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.886s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:18 user nova-compute[72405]: INFO nova.compute.manager [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Terminating instance
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-0eb9b9a8-f729-4a54-aa39-defbc3538614 req-55af7ffe-079c-4d77-be38-e148c551af5e service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0eb9b9a8-f729-4a54-aa39-defbc3538614 req-55af7ffe-079c-4d77-be38-e148c551af5e service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0eb9b9a8-f729-4a54-aa39-defbc3538614 req-55af7ffe-079c-4d77-be38-e148c551af5e service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-0eb9b9a8-f729-4a54-aa39-defbc3538614 req-55af7ffe-079c-4d77-be38-e148c551af5e service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-0eb9b9a8-f729-4a54-aa39-defbc3538614 req-55af7ffe-079c-4d77-be38-e148c551af5e service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-0eb9b9a8-f729-4a54-aa39-defbc3538614 req-55af7ffe-079c-4d77-be38-e148c551af5e service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-unplugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Instance destroyed successfully.
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'resources' on Instance uuid 74c3a8fc-fff0-422f-8583-142d7911e603 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-857807850',display_name='tempest-ServerRescueNegativeTestJSON-server-857807850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-857807850',id=36,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5brvflzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:40:02Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=74c3a8fc-fff0-422f-8583-142d7911e603,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "address": "fa:16:3e:9d:27:0f", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccdec02-1d", "ovs_interfaceid": "5ccdec02-1dec-49f2-a61e-1f5f723aab05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG os_vif [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccdec02-1d, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:54:18 user nova-compute[72405]: INFO os_vif [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:27:0f,bridge_name='br-int',has_traffic_filtering=True,id=5ccdec02-1dec-49f2-a61e-1f5f723aab05,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccdec02-1d')
Aug 08 23:54:18 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Deleting instance files /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603_del
Aug 08 23:54:18 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Deletion of /opt/stack/data/nova/instances/74c3a8fc-fff0-422f-8583-142d7911e603_del complete
Aug 08 23:54:18 user nova-compute[72405]: INFO nova.compute.manager [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 08 23:54:18 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:54:18 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:54:19 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:54:19 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Took 0.48 seconds to deallocate network for instance.
Aug 08 23:54:19 user nova-compute[72405]: DEBUG nova.compute.manager [req-54470879-6b49-46df-b2e1-7874292568b1 req-9999c673-ebdd-4b7d-a792-f7a1d95d35c6 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-deleted-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:54:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:19 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:54:19 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:54:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:19 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Deleted allocations for instance 74c3a8fc-fff0-422f-8583-142d7911e603
Aug 08 23:54:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8dd33633-9770-41e5-9294-7ca49e79891c tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "74c3a8fc-fff0-422f-8583-142d7911e603" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.776s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-9d2e5581-7f81-4aa8-b389-cefda0efec8b req-9ff4afbc-2f97-46dc-9021-054f90e26ef3 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:54:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9d2e5581-7f81-4aa8-b389-cefda0efec8b req-9ff4afbc-2f97-46dc-9021-054f90e26ef3 service nova] Acquiring lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:54:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9d2e5581-7f81-4aa8-b389-cefda0efec8b req-9ff4afbc-2f97-46dc-9021-054f90e26ef3 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:54:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9d2e5581-7f81-4aa8-b389-cefda0efec8b req-9ff4afbc-2f97-46dc-9021-054f90e26ef3 service nova] Lock "74c3a8fc-fff0-422f-8583-142d7911e603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:54:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-9d2e5581-7f81-4aa8-b389-cefda0efec8b req-9ff4afbc-2f97-46dc-9021-054f90e26ef3 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] No waiting events found dispatching network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:54:20 user nova-compute[72405]: WARNING nova.compute.manager [req-9d2e5581-7f81-4aa8-b389-cefda0efec8b req-9ff4afbc-2f97-46dc-9021-054f90e26ef3 service nova] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Received unexpected event network-vif-plugged-5ccdec02-1dec-49f2-a61e-1f5f723aab05 for instance with vm_state deleted and task_state None.
Aug 08 23:54:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:33 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538858.7246187, 74c3a8fc-fff0-422f-8583-142d7911e603 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:54:33 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] VM Stopped (Lifecycle Event)
Aug 08 23:54:33 user nova-compute[72405]: DEBUG nova.compute.manager [None req-82b431a6-dac3-4dd0-8f72-73606f069c33 None None] [instance: 74c3a8fc-fff0-422f-8583-142d7911e603] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:54:33 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:38 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:54:48 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:48 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:54:53 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:54:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:54:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:54:53 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:54:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:54:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:54:58 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:55:00 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:55:01 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:55:01 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.259048461914062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 04f2ae79-2d01-4a28-888c-93b50bc61a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0ed8a421-ad31-4a0e-884e-89021dbd5b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance af42d55e-79ca-489e-a616-cc0387f6d853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:55:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:08 user nova-compute[72405]: INFO nova.compute.manager [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Terminating instance
Aug 08 23:55:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:08 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa76e8a8-998c-4ab8-af2b-b79979420ce6 req-d22acf49-9920-42dc-a95f-0cba5214b295 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa76e8a8-998c-4ab8-af2b-b79979420ce6 req-d22acf49-9920-42dc-a95f-0cba5214b295 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa76e8a8-998c-4ab8-af2b-b79979420ce6 req-d22acf49-9920-42dc-a95f-0cba5214b295 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-fa76e8a8-998c-4ab8-af2b-b79979420ce6 req-d22acf49-9920-42dc-a95f-0cba5214b295 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa76e8a8-998c-4ab8-af2b-b79979420ce6 req-d22acf49-9920-42dc-a95f-0cba5214b295 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.compute.manager [req-fa76e8a8-998c-4ab8-af2b-b79979420ce6 req-d22acf49-9920-42dc-a95f-0cba5214b295 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-unplugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:55:09 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Instance destroyed successfully.
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.objects.instance [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lazy-loading 'resources' on Instance uuid 04f2ae79-2d01-4a28-888c-93b50bc61a07 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-140745293',display_name='tempest-ServerRescueNegativeTestJSON-server-140745293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-140745293',id=35,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:42:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93111863a9dc43b9a50c61a6c1f4c52c',ramdisk_id='',reservation_id='r-5lyapbwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-297666519',owner_user_name='tempest-ServerRescueNegativeTestJSON-297666519-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:44:46Z,user_data=None,user_id='94a805b078b640c29ae13aabfd1fd5a5',uuid=04f2ae79-2d01-4a28-888c-93b50bc61a07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converting VIF {"id": "b831cee5-5e09-444f-98d9-f561e21aa92e", "address": "fa:16:3e:63:5b:43", "network": {"id": "18644bd8-d8f8-4aaa-a55f-e3ea059811f5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1711076529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93111863a9dc43b9a50c61a6c1f4c52c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb831cee5-5e", "ovs_interfaceid": "b831cee5-5e09-444f-98d9-f561e21aa92e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG os_vif [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb831cee5-5e, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:09 user nova-compute[72405]: INFO os_vif [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=b831cee5-5e09-444f-98d9-f561e21aa92e,network=Network(18644bd8-d8f8-4aaa-a55f-e3ea059811f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb831cee5-5e')
Aug 08 23:55:09 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Deleting instance files /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07_del
Aug 08 23:55:09 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Deletion of /opt/stack/data/nova/instances/04f2ae79-2d01-4a28-888c-93b50bc61a07_del complete
Aug 08 23:55:09 user nova-compute[72405]: INFO nova.compute.manager [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 08 23:55:09 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:55:09 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:55:10 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Took 0.50 seconds to deallocate network for instance.
Aug 08 23:55:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-acf750e0-d4b5-4779-ab4b-bb15ae3577a1 req-ddff80d4-0da4-41c6-9534-9df2a8cce408 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-deleted-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:55:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:10 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Deleted allocations for instance 04f2ae79-2d01-4a28-888c-93b50bc61a07
Aug 08 23:55:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-84ddc920-df7e-4fcf-8283-acf4078d8e9a tempest-ServerRescueNegativeTestJSON-297666519 tempest-ServerRescueNegativeTestJSON-297666519-project-member] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.527s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-7f0a4429-a9c7-41e8-936a-5c5bad0c5619 req-532caa96-95a5-4390-963c-830d53c2ff21 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7f0a4429-a9c7-41e8-936a-5c5bad0c5619 req-532caa96-95a5-4390-963c-830d53c2ff21 service nova] Acquiring lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7f0a4429-a9c7-41e8-936a-5c5bad0c5619 req-532caa96-95a5-4390-963c-830d53c2ff21 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7f0a4429-a9c7-41e8-936a-5c5bad0c5619 req-532caa96-95a5-4390-963c-830d53c2ff21 service nova] Lock "04f2ae79-2d01-4a28-888c-93b50bc61a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-7f0a4429-a9c7-41e8-936a-5c5bad0c5619 req-532caa96-95a5-4390-963c-830d53c2ff21 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] No waiting events found dispatching network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:55:11 user nova-compute[72405]: WARNING nova.compute.manager [req-7f0a4429-a9c7-41e8-936a-5c5bad0c5619 req-532caa96-95a5-4390-963c-830d53c2ff21 service nova] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Received unexpected event network-vif-plugged-b831cee5-5e09-444f-98d9-f561e21aa92e for instance with vm_state deleted and task_state None.
Aug 08 23:55:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538909.446744, 04f2ae79-2d01-4a28-888c-93b50bc61a07 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:55:24 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] VM Stopped (Lifecycle Event)
Aug 08 23:55:24 user nova-compute[72405]: DEBUG nova.compute.manager [None req-d862528d-446a-46b7-8457-26318b213b18 None None] [instance: 04f2ae79-2d01-4a28-888c-93b50bc61a07] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:55:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-changed-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG nova.compute.manager [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Refreshing instance network info cache due to event network-changed-41b4bd08-1292-41a1-b966-3075d0b9dd76. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] Acquiring lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] Acquired lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Refreshing network info cache for port 41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updated VIF entry in instance network info cache for port 41b4bd08-1292-41a1-b966-3075d0b9dd76. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG nova.network.neutron [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating instance_info_cache with network_info: [{"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:55:43 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1e8b222b-7a95-4f84-b82b-b86718a927ef req-751596a4-6d06-42f4-8c9b-d09cd43a6310 service nova] Releasing lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "af42d55e-79ca-489e-a616-cc0387f6d853" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:44 user nova-compute[72405]: INFO nova.compute.manager [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Terminating instance
Aug 08 23:55:44 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-changed-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG nova.compute.manager [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Refreshing instance network info cache due to event network-changed-41b4bd08-1292-41a1-b966-3075d0b9dd76. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] Acquiring lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] Acquired lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Refreshing network info cache for port 41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updated VIF entry in instance network info cache for port 41b4bd08-1292-41a1-b966-3075d0b9dd76. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG nova.network.neutron [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating instance_info_cache with network_info: [{"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:55:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-aafb6701-b2d6-490f-b4e9-dbdbb8a69be7 req-ba6790bf-1861-45cd-8393-8b1b1e95057e service nova] Releasing lock "refresh_cache-af42d55e-79ca-489e-a616-cc0387f6d853" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:55:45 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Instance destroyed successfully.
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'resources' on Instance uuid af42d55e-79ca-489e-a616-cc0387f6d853 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-91302134',display_name='tempest-TestVolumeBootPattern-server-91302134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-91302134',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-uvlk159b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:54:11Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=af42d55e-79ca-489e-a616-cc0387f6d853,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "address": "fa:16:3e:2c:98:c3", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b4bd08-12", "ovs_interfaceid": "41b4bd08-1292-41a1-b966-3075d0b9dd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_vif [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41b4bd08-12, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:45 user nova-compute[72405]: INFO os_vif [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:98:c3,bridge_name='br-int',has_traffic_filtering=True,id=41b4bd08-1292-41a1-b966-3075d0b9dd76,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b4bd08-12')
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTHGYUbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:55:45 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbede028-568a-4485-8a89-1315d02d9c18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09f0d30-6c0d-473a-8bae-3d9e4f37904d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:55:45 user nova-compute[72405]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e (non-flash)
Aug 08 23:55:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:55:45 user nova-compute[72405]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e (non-flash)
Aug 08 23:55:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54fbdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b2b19-0989-4d06-aa98-27036b252d73]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-vif-unplugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] No waiting events found dispatching network-vif-unplugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-vif-unplugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] Acquiring lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] Lock "af42d55e-79ca-489e-a616-cc0387f6d853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] No waiting events found dispatching network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:55:45 user nova-compute[72405]: WARNING nova.compute.manager [req-2dec1ab3-92e2-4441-8219-b813fa2b2015 req-dfdf5ec2-a4f9-45c7-a6e8-5059c1bb19ca service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received unexpected event network-vif-plugged-41b4bd08-1292-41a1-b966-3075d0b9dd76 for instance with vm_state active and task_state deleting.
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bceb3-3717-4e16-9798-465d970aa0c8]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268159f-6456-43d8-b516-299964f6980c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa3b8d2-e36f-4632-a993-fa3eac77e2ba]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ca38bd8', '/dev/disk/by-id/scsi-1SCST_BIO7ca38bd8-8df8b41669aa061c', '/dev/disk/by-id/scsi-23864663862343136') {{(pid=83323) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8978e21e-e552-4b09-b5f4-70b10a15a36e]: (4, None) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[775b896b-fa52-42e8-83c1-b6d1d4390f5c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[779a20ae-c2d0-4aa2-bc83-4ba7c756063e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260]
Aug 08 23:55:45 user nova-compute[72405]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e, portal: 172.16.0.220,3260] successful.
Aug 08 23:55:45 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54961877-cc78-49ce-aa3a-7eb685a27c9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3111b-f974-4696-a1d7-e4966784287a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== disconnect_volume: return (272ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:55:45 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Deleting instance files /opt/stack/data/nova/instances/af42d55e-79ca-489e-a616-cc0387f6d853_del
Aug 08 23:55:45 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Deletion of /opt/stack/data/nova/instances/af42d55e-79ca-489e-a616-cc0387f6d853_del complete
Aug 08 23:55:45 user nova-compute[72405]: INFO nova.compute.manager [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 08 23:55:45 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.compute.manager [req-7dcf4837-77fa-493e-b972-682cc8f3967d req-6587b3be-9c57-4c63-b211-0df574dd1e80 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Received event network-vif-deleted-41b4bd08-1292-41a1-b966-3075d0b9dd76 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:55:45 user nova-compute[72405]: INFO nova.compute.manager [req-7dcf4837-77fa-493e-b972-682cc8f3967d req-6587b3be-9c57-4c63-b211-0df574dd1e80 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Neutron deleted interface 41b4bd08-1292-41a1-b966-3075d0b9dd76; detaching it from the instance and deleting it from the info cache
Aug 08 23:55:45 user nova-compute[72405]: DEBUG nova.network.neutron [req-7dcf4837-77fa-493e-b972-682cc8f3967d req-6587b3be-9c57-4c63-b211-0df574dd1e80 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:55:45 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Took 0.47 seconds to deallocate network for instance.
Aug 08 23:55:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-7dcf4837-77fa-493e-b972-682cc8f3967d req-6587b3be-9c57-4c63-b211-0df574dd1e80 service nova] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Detach interface failed, port_id=41b4bd08-1292-41a1-b966-3075d0b9dd76, reason: Instance af42d55e-79ca-489e-a616-cc0387f6d853 could not be found. {{(pid=72405) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 08 23:55:46 user nova-compute[72405]: INFO nova.compute.manager [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Took 0.80 seconds to detach 1 volumes for instance.
Aug 08 23:55:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:55:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:55:46 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:55:46 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:55:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:47 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Deleted allocations for instance af42d55e-79ca-489e-a616-cc0387f6d853
Aug 08 23:55:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bd28e10b-c0c1-46c4-ad77-bd9b005cffe6 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "af42d55e-79ca-489e-a616-cc0387f6d853" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.719s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:55:49 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:55:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:55:55 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 0ed8a421-ad31-4a0e-884e-89021dbd5b27 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:55:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:55:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:55:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:55:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:55:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:55:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:00 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691538945.1499774, af42d55e-79ca-489e-a616-cc0387f6d853 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:56:00 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] VM Stopped (Lifecycle Event)
Aug 08 23:56:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-5976ad32-e00b-4987-9c9b-b58c6d719e31 None None] [instance: af42d55e-79ca-489e-a616-cc0387f6d853] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:56:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:56:02 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 08 23:56:03 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:56:03 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.2783203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 0ed8a421-ad31-4a0e-884e-89021dbd5b27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:56:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:56:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-changed-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG nova.compute.manager [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Refreshing instance network info cache due to event network-changed-c66afa09-c963-46de-9023-e77b0ab12e8c. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] Acquiring lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] Acquired lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG nova.network.neutron [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Refreshing network info cache for port c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:46 user nova-compute[72405]: INFO nova.compute.manager [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Terminating instance
Aug 08 23:56:46 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.network.neutron [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updated VIF entry in instance network info cache for port c66afa09-c963-46de-9023-e77b0ab12e8c. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.network.neutron [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [{"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-94c5aaa9-a302-4ac5-898a-c67a2b7136c2 req-72d74f5d-24ab-4a06-a2fc-e06cb0e8086b service nova] Releasing lock "refresh_cache-0ed8a421-ad31-4a0e-884e-89021dbd5b27" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:56:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Instance destroyed successfully.
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lazy-loading 'resources' on Instance uuid 0ed8a421-ad31-4a0e-884e-89021dbd5b27 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1511778438',display_name='tempest-TestVolumeBootPattern-server-1511778438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1511778438',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD73e6N6nluk3AdCk9fTAp852f/LDuRWnxrH7/rYohM92O2Dx2jmWLFDmYMDwt12mnrxkgGbfE37PUkXu//VbgFz7OPN8/2T9Xjg3kqnBELhXY6fFF9nM23B7OK5sT9fKQ==',key_name='tempest-TestVolumeBootPattern-1238503258',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:52:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc0496a99448ce8705555dc3ed9c45',ramdisk_id='',reservation_id='r-z15p42gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1873778230',owner_user_name='tempest-TestVolumeBootPattern-1873778230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:52:02Z,user_data=None,user_id='a246e22061eb47eda51b4b6634102922',uuid=0ed8a421-ad31-4a0e-884e-89021dbd5b27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converting VIF {"id": "c66afa09-c963-46de-9023-e77b0ab12e8c", "address": "fa:16:3e:26:cd:01", "network": {"id": "532de8cf-586f-4520-b1d8-20690560a875", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-35665233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc0496a99448ce8705555dc3ed9c45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66afa09-c9", "ovs_interfaceid": "c66afa09-c963-46de-9023-e77b0ab12e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_vif [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66afa09-c9, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:56:47 user nova-compute[72405]: INFO os_vif [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=c66afa09-c963-46de-9023-e77b0ab12e8c,network=Network(532de8cf-586f-4520-b1d8-20690560a875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66afa09-c9')
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdfIFvKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:56:47 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b23208c-118d-4f47-b14c-e4e7d2534943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf338aa-9df9-41fa-ad8c-2755a0a15d29]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:56:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 (non-flash)
Aug 08 23:56:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb9c954e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289'): ({'sdc'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Removing single pathed devices sdc {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e45333-a3cf-4584-b237-1cf085817bb8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd87cd2-da59-4de2-b4a7-fe3e4f1fab1a]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Flushing IO for device /dev/sdc {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d9044-37b7-46f4-aa61-d383e40217a9]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.072s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfb3817-c6c8-43a8-8b70-b64578bfe097]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] SCSI volumes sdc have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[28547e7c-c2a7-4545-a49a-d37c832c8f5c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 08 23:56:47 user nova-compute[72405]: INFO nova.compute.claims [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Claim successful on node user
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24e4628-4a72-453b-aa8e-85dc7c730200]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260]
Aug 08 23:56:47 user nova-compute[72405]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289, portal: 172.16.0.220,3260] successful.
Aug 08 23:56:47 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a3a61b-8845-4b00-a80c-8b944cb4b289 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2093ccb6-dad5-4f56-8dd6-391d57e24222]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] <== disconnect_volume: return (317ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:56:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Deleting instance files /opt/stack/data/nova/instances/0ed8a421-ad31-4a0e-884e-89021dbd5b27_del
Aug 08 23:56:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Deletion of /opt/stack/data/nova/instances/0ed8a421-ad31-4a0e-884e-89021dbd5b27_del complete
Aug 08 23:56:47 user nova-compute[72405]: INFO nova.compute.manager [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 08 23:56:47 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 08 23:56:47 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.policy [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e775089e8364f60bb3776f90ba24fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28489957c36c46c482fdc588b00e85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 08 23:56:48 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Creating image(s)
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "/opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "/opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "/opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.149s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-vif-unplugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] No waiting events found dispatching network-vif-unplugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-vif-unplugged-c66afa09-c963-46de-9023-e77b0ab12e8c for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] Acquiring lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.compute.manager [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] No waiting events found dispatching network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:56:48 user nova-compute[72405]: WARNING nova.compute.manager [req-035a9376-50c0-427f-a601-8790b6a473d1 req-7d21fb76-745e-4d16-85cc-0cec52e46891 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received unexpected event network-vif-plugged-c66afa09-c963-46de-9023-e77b0ab12e8c for instance with vm_state active and task_state deleting.
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.143s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk 1073741824" returned: 0 in 0.055s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:56:48 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Took 0.95 seconds to deallocate network for instance.
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.155s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Cannot resize image /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lazy-loading 'migration_context' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Ensure instance console log exists: /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:48 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Successfully created port: 607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 08 23:56:49 user nova-compute[72405]: INFO nova.compute.manager [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Took 0.79 seconds to detach 1 volumes for instance.
Aug 08 23:56:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:49 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Deleted allocations for instance 0ed8a421-ad31-4a0e-884e-89021dbd5b27
Aug 08 23:56:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bafc9a93-3aa0-49f3-bd77-2ebf11f8ed99 tempest-TestVolumeBootPattern-1873778230 tempest-TestVolumeBootPattern-1873778230-project-member] Lock "0ed8a421-ad31-4a0e-884e-89021dbd5b27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.282s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Successfully updated port: 607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquired lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 08 23:56:49 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.neutron [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Releasing lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Instance network_info: |[{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Start _get_guest_xml network_info=[{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 08 23:56:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:56:50 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3136357',id=49,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQJHSaWM8I1Ub1V429Mj2457heIaOFncUbvopc2G+Pk6ZiejWfoRvRjO8A6W7lcq4zpAFovE7FrR4Z4zmepK39dHuBmzPAbztQCMamY7LMs+RAk3ry8mU+Twr+FpHXU8Q==',key_name='tempest-keypair-1715384255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28489957c36c46c482fdc588b00e85df',ramdisk_id='',reservation_id='r-4kavdp19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-142301467',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:56:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e775089e8364f60bb3776f90ba24fe1',uuid=60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Converting VIF {"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lazy-loading 'pci_devices' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] End _get_guest_xml xml=<domain type="kvm">
Aug 08 23:56:50 user nova-compute[72405]:   <uuid>60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196</uuid>
Aug 08 23:56:50 user nova-compute[72405]:   <name>instance-00000031</name>
Aug 08 23:56:50 user nova-compute[72405]:   <memory>524288</memory>
Aug 08 23:56:50 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 08 23:56:50 user nova-compute[72405]:   <metadata>
Aug 08 23:56:50 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 08 23:56:50 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 08 23:56:50 user nova-compute[72405]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796</nova:name>
Aug 08 23:56:50 user nova-compute[72405]:       <nova:creationTime>2023-08-08 23:56:50</nova:creationTime>
Aug 08 23:56:50 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 08 23:56:50 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 08 23:56:50 user nova-compute[72405]:       </nova:flavor>
Aug 08 23:56:50 user nova-compute[72405]:       <nova:owner>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:user uuid="0e775089e8364f60bb3776f90ba24fe1">tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member</nova:user>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:project uuid="28489957c36c46c482fdc588b00e85df">tempest-TestServerVolumeAttachScenarioOldVersion-142301467</nova:project>
Aug 08 23:56:50 user nova-compute[72405]:       </nova:owner>
Aug 08 23:56:50 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 08 23:56:50 user nova-compute[72405]:       <nova:ports>
Aug 08 23:56:50 user nova-compute[72405]:         <nova:port uuid="607a978c-d446-4e98-aa1d-ac3ba0529fd0">
Aug 08 23:56:50 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 08 23:56:50 user nova-compute[72405]:         </nova:port>
Aug 08 23:56:50 user nova-compute[72405]:       </nova:ports>
Aug 08 23:56:50 user nova-compute[72405]:     </nova:instance>
Aug 08 23:56:50 user nova-compute[72405]:   </metadata>
Aug 08 23:56:50 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 08 23:56:50 user nova-compute[72405]:     <system>
Aug 08 23:56:50 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 08 23:56:50 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 08 23:56:50 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 08 23:56:50 user nova-compute[72405]:       <entry name="serial">60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196</entry>
Aug 08 23:56:50 user nova-compute[72405]:       <entry name="uuid">60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196</entry>
Aug 08 23:56:50 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 08 23:56:50 user nova-compute[72405]:     </system>
Aug 08 23:56:50 user nova-compute[72405]:   </sysinfo>
Aug 08 23:56:50 user nova-compute[72405]:   <os>
Aug 08 23:56:50 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 08 23:56:50 user nova-compute[72405]:     <boot dev="hd"/>
Aug 08 23:56:50 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 08 23:56:50 user nova-compute[72405]:   </os>
Aug 08 23:56:50 user nova-compute[72405]:   <features>
Aug 08 23:56:50 user nova-compute[72405]:     <acpi/>
Aug 08 23:56:50 user nova-compute[72405]:     <apic/>
Aug 08 23:56:50 user nova-compute[72405]:     <vmcoreinfo/>
Aug 08 23:56:50 user nova-compute[72405]:   </features>
Aug 08 23:56:50 user nova-compute[72405]:   <clock offset="utc">
Aug 08 23:56:50 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 08 23:56:50 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 08 23:56:50 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 08 23:56:50 user nova-compute[72405]:   </clock>
Aug 08 23:56:50 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 08 23:56:50 user nova-compute[72405]:     <model>Nehalem</model>
Aug 08 23:56:50 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 08 23:56:50 user nova-compute[72405]:   </cpu>
Aug 08 23:56:50 user nova-compute[72405]:   <devices>
Aug 08 23:56:50 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 08 23:56:50 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 08 23:56:50 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk"/>
Aug 08 23:56:50 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 08 23:56:50 user nova-compute[72405]:     </disk>
Aug 08 23:56:50 user nova-compute[72405]:     <interface type="ethernet">
Aug 08 23:56:50 user nova-compute[72405]:       <mac address="fa:16:3e:59:4c:98"/>
Aug 08 23:56:50 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:56:50 user nova-compute[72405]:       <mtu size="1442"/>
Aug 08 23:56:50 user nova-compute[72405]:       <target dev="tap607a978c-d4"/>
Aug 08 23:56:50 user nova-compute[72405]:     </interface>
Aug 08 23:56:50 user nova-compute[72405]:     <serial type="pty">
Aug 08 23:56:50 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/console.log" append="off"/>
Aug 08 23:56:50 user nova-compute[72405]:     </serial>
Aug 08 23:56:50 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 08 23:56:50 user nova-compute[72405]:     <video>
Aug 08 23:56:50 user nova-compute[72405]:       <model type="virtio"/>
Aug 08 23:56:50 user nova-compute[72405]:     </video>
Aug 08 23:56:50 user nova-compute[72405]:     <rng model="virtio">
Aug 08 23:56:50 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 08 23:56:50 user nova-compute[72405]:     </rng>
Aug 08 23:56:50 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 08 23:56:50 user nova-compute[72405]:     <memballoon model="virtio">
Aug 08 23:56:50 user nova-compute[72405]:       <stats period="10"/>
Aug 08 23:56:50 user nova-compute[72405]:     </memballoon>
Aug 08 23:56:50 user nova-compute[72405]:   </devices>
Aug 08 23:56:50 user nova-compute[72405]: </domain>
Aug 08 23:56:50 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3136357',id=49,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQJHSaWM8I1Ub1V429Mj2457heIaOFncUbvopc2G+Pk6ZiejWfoRvRjO8A6W7lcq4zpAFovE7FrR4Z4zmepK39dHuBmzPAbztQCMamY7LMs+RAk3ry8mU+Twr+FpHXU8Q==',key_name='tempest-keypair-1715384255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28489957c36c46c482fdc588b00e85df',ramdisk_id='',reservation_id='r-4kavdp19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-142301467',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-08T23:56:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e775089e8364f60bb3776f90ba24fe1',uuid=60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Converting VIF {"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG os_vif [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap607a978c-d4, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap607a978c-d4, col_values=(('external_ids', {'iface-id': '607a978c-d446-4e98-aa1d-ac3ba0529fd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:4c:98', 'vm-uuid': '60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:50 user nova-compute[72405]: INFO os_vif [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4')
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Received event network-vif-deleted-c66afa09-c963-46de-9023-e77b0ab12e8c {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-changed-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.compute.manager [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Refreshing instance network info cache due to event network-changed-607a978c-d446-4e98-aa1d-ac3ba0529fd0. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] Acquiring lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] Acquired lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Refreshing network info cache for port 607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] No VIF found with MAC fa:16:3e:59:4c:98, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updated VIF entry in instance network info cache for port 607a978c-d446-4e98-aa1d-ac3ba0529fd0. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG nova.network.neutron [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:56:50 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-e7f7392a-8c64-46f5-8987-464672ffaa1f req-15bf0afc-6ba1-40b6-a6f5-acf56bda1084 service nova] Releasing lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-1215b8a2-7b56-43c5-97dc-05c8be9ed02c req-c4521bf5-0dbf-45e8-ac5b-563c89f64539 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1215b8a2-7b56-43c5-97dc-05c8be9ed02c req-c4521bf5-0dbf-45e8-ac5b-563c89f64539 service nova] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1215b8a2-7b56-43c5-97dc-05c8be9ed02c req-c4521bf5-0dbf-45e8-ac5b-563c89f64539 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1215b8a2-7b56-43c5-97dc-05c8be9ed02c req-c4521bf5-0dbf-45e8-ac5b-563c89f64539 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-1215b8a2-7b56-43c5-97dc-05c8be9ed02c req-c4521bf5-0dbf-45e8-ac5b-563c89f64539 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] No waiting events found dispatching network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:56:51 user nova-compute[72405]: WARNING nova.compute.manager [req-1215b8a2-7b56-43c5-97dc-05c8be9ed02c req-c4521bf5-0dbf-45e8-ac5b-563c89f64539 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received unexpected event network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 for instance with vm_state building and task_state spawning.
Aug 08 23:56:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539013.853735, 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:56:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] VM Resumed (Lifecycle Event)
Aug 08 23:56:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Instance spawned successfully.
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 08 23:56:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539013.853928, 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:56:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] VM Started (Lifecycle Event)
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 08 23:56:53 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 08 23:56:53 user nova-compute[72405]: INFO nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-c4dfe739-3e42-4839-8ef2-0fb16ac611df req-15434042-ba07-4f3d-805c-4ebbf3743b47 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c4dfe739-3e42-4839-8ef2-0fb16ac611df req-15434042-ba07-4f3d-805c-4ebbf3743b47 service nova] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c4dfe739-3e42-4839-8ef2-0fb16ac611df req-15434042-ba07-4f3d-805c-4ebbf3743b47 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c4dfe739-3e42-4839-8ef2-0fb16ac611df req-15434042-ba07-4f3d-805c-4ebbf3743b47 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:53 user nova-compute[72405]: DEBUG nova.compute.manager [req-c4dfe739-3e42-4839-8ef2-0fb16ac611df req-15434042-ba07-4f3d-805c-4ebbf3743b47 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] No waiting events found dispatching network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:56:53 user nova-compute[72405]: WARNING nova.compute.manager [req-c4dfe739-3e42-4839-8ef2-0fb16ac611df req-15434042-ba07-4f3d-805c-4ebbf3743b47 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received unexpected event network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 for instance with vm_state building and task_state spawning.
Aug 08 23:56:54 user nova-compute[72405]: INFO nova.compute.manager [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Took 6.63 seconds to build instance.
Aug 08 23:56:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e3411e17-3f00-43a2-b83c-a7ea3c81a45e tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:56:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:56:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:56:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:56:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:56:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:56:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:56:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:56:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:02 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691539007.1437225, 0ed8a421-ad31-4a0e-884e-89021dbd5b27 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 08 23:57:02 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] VM Stopped (Lifecycle Event)
Aug 08 23:57:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-856a5f85-ae7a-41f3-9324-142b8603bb8e None None] [instance: 0ed8a421-ad31-4a0e-884e-89021dbd5b27] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:04 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:57:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:57:05 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.274417877197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:57:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:57:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:57:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:57:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:57:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:57:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:57:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:57:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:57:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:57:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:57:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:57:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:52 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:57:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:57:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:57:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:57:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:57:56 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:57:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:57:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:57:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:57:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:57:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:57:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:58:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:06 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:07 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:58:07 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.245315551757812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:58:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:58:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Verify base images {{(pid=72405) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Image id ed72958c-30b3-4e1d-9bb6-9c0404b96321 yields fingerprint f7d45b25b50785349c4f4661c765c34d33e56f4b {{(pid=72405) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] image ed72958c-30b3-4e1d-9bb6-9c0404b96321 at (/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b): checking
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] image ed72958c-30b3-4e1d-9bb6-9c0404b96321 at (/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b): image is in use {{(pid=72405) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72405) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 is a valid instance name {{(pid=72405) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 has a disk file {{(pid=72405) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 is backed by f7d45b25b50785349c4f4661c765c34d33e56f4b {{(pid=72405) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf
Aug 08 23:58:21 user nova-compute[72405]: WARNING nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Active base files: /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Removable base files: /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9 /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660 /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72 /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3573230327a96d20d143387e1a542db074d9f8b9
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ae8d6b90abb12a753c7e5dacb8a2f22064421660
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5a3ccf3cf5922203f0a6e60cae557a375938f7a
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e779f19e0bc6e9ebba2b1aca3c365f9e95e90f72
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05f7c0e00868f631bb36d15fdc4764fb40103e1b
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e1f13e65b20d6f708730ded5c226d8e0bdde5cfd
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/878d731a102fb9968766bb6d83e0747c055829cf
Aug 08 23:58:21 user nova-compute[72405]: INFO nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/18cd5b9fe964dfcd18950ef1dde087ba625ed0fd
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Verification complete {{(pid=72405) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Verify swap images {{(pid=72405) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 08 23:58:21 user nova-compute[72405]: DEBUG nova.virt.libvirt.imagecache [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Verify ephemeral images {{(pid=72405) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 08 23:58:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:58:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:58:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:58:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-changed-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:58:38 user nova-compute[72405]: DEBUG nova.compute.manager [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Refreshing instance network info cache due to event network-changed-607a978c-d446-4e98-aa1d-ac3ba0529fd0. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 08 23:58:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] Acquiring lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:58:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] Acquired lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:58:38 user nova-compute[72405]: DEBUG nova.network.neutron [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Refreshing network info cache for port 607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 08 23:58:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updated VIF entry in instance network info cache for port 607a978c-d446-4e98-aa1d-ac3ba0529fd0. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 08 23:58:39 user nova-compute[72405]: DEBUG nova.network.neutron [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:58:39 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8417b027-40d8-4a1e-b1e6-63458b2ebdd8 req-8adb959d-8ecf-4c66-851c-e6f66a3e83f0 service nova] Releasing lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:58:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lazy-loading 'flavor' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:42 user nova-compute[72405]: INFO nova.compute.manager [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Attaching volume f7e46bf0-12f9-49c6-978d-2126a98fdabc to /dev/vdb
Aug 08 23:58:42 user nova-compute[72405]: DEBUG os_brick.utils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[482e3960-94c5-4123-8703-526ed4a1a90d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe430f91-d02c-4b52-a530-2f3a26090ad7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4454b2d-817e-4578-bf63-14b59feae0ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cafc9b4-ef9f-4671-b0e7-f134f62b994e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:42 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 08 23:58:43 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 08 23:58:43 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6c827d-eb29-4942-9813-1c70feb794b0]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG os_brick.utils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:58:43 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating existing volume attachment record: 5143fdfc-6e7a-44fa-ae4a-8a2d958050d5 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 08 23:58:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUKrpLgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:58:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:58:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:58:50 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50cd18c-e4eb-40c2-81d6-893bc9107054]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 08 23:58:50 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b50dc-1e56-4293-aa5b-a6ef6ab2556e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc] added
Aug 08 23:58:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cc6da-86d6-4371-a2c2-f49cda85a6b1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb90c9-2214-41a7-b31e-7380b1ff4bf6]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUKrpLgv {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUKrpLgv" returned: 0 in 0.027s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eda30b-a1b8-407a-8f55-27da067dcba3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XUKrpLgv'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d65026-6455-4945-81c0-7900b923b0ee]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[063392cd-4569-4cf3-83d9-65e42135935d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:58:50 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 08 23:58:50 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:58:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 08 23:58:50 user nova-compute[72405]: 
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[74afa1ee-adae-493e-bf00-2a42c67c3649]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260]
Aug 08 23:58:50 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260] successful.
Aug 08 23:58:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45c403-8eb8-4607-af2e-26772a85ae41]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6735ad62-6b85-45d9-b30c-dd0221710e25]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc (non-flash)
Aug 08 23:58:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc (non-flash)
Aug 08 23:58:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab25f6d-61d7-41e5-92fb-b1e0a792d151]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUKrpLgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23233326434613762', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233326434613762', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lazy-loading 'flavor' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:58:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] attach device xml: <disk type="block" device="disk">
Aug 08 23:58:51 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:58:51 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:58:51 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:58:51 user nova-compute[72405]:   <serial>f7e46bf0-12f9-49c6-978d-2126a98fdabc</serial>
Aug 08 23:58:51 user nova-compute[72405]: </disk>
Aug 08 23:58:51 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 08 23:58:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:58:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 08 23:58:52 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] No VIF found with MAC fa:16:3e:59:4c:98, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 08 23:58:52 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-5a635432-ba4d-4407-9072-e756bb6648d9 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.630s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:58:53 user nova-compute[72405]: INFO nova.compute.manager [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Detaching volume f7e46bf0-12f9-49c6-978d-2126a98fdabc
Aug 08 23:58:53 user nova-compute[72405]: INFO nova.virt.block_device [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Attempting to driver detach volume f7e46bf0-12f9-49c6-978d-2126a98fdabc from mountpoint /dev/vdb
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Attempting to detach device vdb from instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:58:53 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:58:53 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:58:53 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:58:53 user nova-compute[72405]:   <serial>f7e46bf0-12f9-49c6-978d-2126a98fdabc</serial>
Aug 08 23:58:53 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:58:53 user nova-compute[72405]: </disk>
Aug 08 23:58:53 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:58:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Successfully detached device vdb from instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 from the persistent domain config.
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] detach device xml: <disk type="block" device="disk">
Aug 08 23:58:53 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 08 23:58:53 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 08 23:58:53 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 08 23:58:53 user nova-compute[72405]:   <serial>f7e46bf0-12f9-49c6-978d-2126a98fdabc</serial>
Aug 08 23:58:53 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 08 23:58:53 user nova-compute[72405]: </disk>
Aug 08 23:58:53 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691539133.904887, 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 08 23:58:53 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Successfully detached device vdb from instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 from the live domain config.
Aug 08 23:58:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUKrpLgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 08 23:58:53 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[47508c6f-1c41-4294-876c-d8ce433c2d22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf7615e-ea23-4ad4-8370-363be5a2bcc6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc (non-flash)
Aug 08 23:58:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc (non-flash)
Aug 08 23:58:53 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb7820f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b152fa0d-2fa1-4057-b3d1-52394e9d9647]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:53 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa107b3-c8e1-4810-8517-25699f7660a8]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e7369-4154-4f17-8370-6e0d956165e1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5e131b-4b1e-4083-98af-919095f6424a]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[473fa3c7-030a-4d9b-8ea1-ae21728145c0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5190c87d-dafb-48f2-917e-2eb988af1ab8]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260]
Aug 08 23:58:54 user nova-compute[72405]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc, portal: 172.16.0.220,3260] successful.
Aug 08 23:58:54 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e46bf0-12f9-49c6-978d-2126a98fdabc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf33a7-1677-4c5b-b4c5-350d64a4bf14]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.240s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] <== disconnect_volume: return (241ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG nova.objects.instance [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lazy-loading 'flavor' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-2d3c860c-d74f-474c-8c78-bee4ff00ee43 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.497s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:58:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:58:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 08 23:58:55 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 08 23:58:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [{"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:58:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:58:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:00 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 08 23:59:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 08 23:59:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 08 23:59:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:59:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.244155883789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 08 23:59:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 08 23:59:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 08 23:59:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:49 user nova-compute[72405]: INFO nova.compute.manager [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Terminating instance
Aug 08 23:59:49 user nova-compute[72405]: DEBUG nova.compute.manager [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-1325d2ea-2da3-4c18-a20d-7984a692636e req-c1e2e093-3fec-458a-bbcf-8160a1632809 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-vif-unplugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1325d2ea-2da3-4c18-a20d-7984a692636e req-c1e2e093-3fec-458a-bbcf-8160a1632809 service nova] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1325d2ea-2da3-4c18-a20d-7984a692636e req-c1e2e093-3fec-458a-bbcf-8160a1632809 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1325d2ea-2da3-4c18-a20d-7984a692636e req-c1e2e093-3fec-458a-bbcf-8160a1632809 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-1325d2ea-2da3-4c18-a20d-7984a692636e req-c1e2e093-3fec-458a-bbcf-8160a1632809 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] No waiting events found dispatching network-vif-unplugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG nova.compute.manager [req-1325d2ea-2da3-4c18-a20d-7984a692636e req-c1e2e093-3fec-458a-bbcf-8160a1632809 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-vif-unplugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 08 23:59:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Instance destroyed successfully.
Aug 08 23:59:50 user nova-compute[72405]: DEBUG nova.objects.instance [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lazy-loading 'resources' on Instance uuid 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-08T23:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-313635796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3136357',id=49,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQJHSaWM8I1Ub1V429Mj2457heIaOFncUbvopc2G+Pk6ZiejWfoRvRjO8A6W7lcq4zpAFovE7FrR4Z4zmepK39dHuBmzPAbztQCMamY7LMs+RAk3ry8mU+Twr+FpHXU8Q==',key_name='tempest-keypair-1715384255',keypairs=<?>,launch_index=0,launched_at=2023-08-08T23:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28489957c36c46c482fdc588b00e85df',ramdisk_id='',reservation_id='r-4kavdp19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-142301467',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-08T23:56:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e775089e8364f60bb3776f90ba24fe1',uuid=60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Converting VIF {"id": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "address": "fa:16:3e:59:4c:98", "network": {"id": "66a3d812-56ef-457a-8226-80b019b380f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-772816100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28489957c36c46c482fdc588b00e85df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap607a978c-d4", "ovs_interfaceid": "607a978c-d446-4e98-aa1d-ac3ba0529fd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG os_vif [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap607a978c-d4, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 08 23:59:50 user nova-compute[72405]: INFO os_vif [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:4c:98,bridge_name='br-int',has_traffic_filtering=True,id=607a978c-d446-4e98-aa1d-ac3ba0529fd0,network=Network(66a3d812-56ef-457a-8226-80b019b380f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap607a978c-d4')
Aug 08 23:59:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Deleting instance files /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196_del
Aug 08 23:59:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Deletion of /opt/stack/data/nova/instances/60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196_del complete
Aug 08 23:59:50 user nova-compute[72405]: INFO nova.compute.manager [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 08 23:59:50 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 08 23:59:50 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 08 23:59:51 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Took 1.20 seconds to deallocate network for instance.
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-d01992d2-8df1-4f6b-a706-6e9d2d213873 req-6adc2812-f720-4f2f-a34c-bde30c4b3832 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-vif-deleted-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:51 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Deleted allocations for instance 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-900f1373-0b1e-4d18-ad9e-015cec6984d8 tempest-TestServerVolumeAttachScenarioOldVersion-142301467 tempest-TestServerVolumeAttachScenarioOldVersion-142301467-project-member] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-844484a9-0cff-43df-9c4e-21660328aede req-2a8d7d0e-7786-417b-8ea0-1fb815c0fcf4 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received event network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-844484a9-0cff-43df-9c4e-21660328aede req-2a8d7d0e-7786-417b-8ea0-1fb815c0fcf4 service nova] Acquiring lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-844484a9-0cff-43df-9c4e-21660328aede req-2a8d7d0e-7786-417b-8ea0-1fb815c0fcf4 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-844484a9-0cff-43df-9c4e-21660328aede req-2a8d7d0e-7786-417b-8ea0-1fb815c0fcf4 service nova] Lock "60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 08 23:59:51 user nova-compute[72405]: DEBUG nova.compute.manager [req-844484a9-0cff-43df-9c4e-21660328aede req-2a8d7d0e-7786-417b-8ea0-1fb815c0fcf4 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] No waiting events found dispatching network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 08 23:59:51 user nova-compute[72405]: WARNING nova.compute.manager [req-844484a9-0cff-43df-9c4e-21660328aede req-2a8d7d0e-7786-417b-8ea0-1fb815c0fcf4 service nova] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Received unexpected event network-vif-plugged-607a978c-d446-4e98-aa1d-ac3ba0529fd0 for instance with vm_state deleted and task_state None.
Aug 08 23:59:54 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 08 23:59:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:57 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 08 23:59:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 08 23:59:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 08 23:59:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 08 23:59:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:00:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:00:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:05 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691539190.0459304, 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:00:05 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] VM Stopped (Lifecycle Event)
Aug 09 00:00:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-68be1cc9-303c-48c1-9aa9-f4e3d868f47a None None] [instance: 60a5f1a0-bd59-4f6d-a48b-f7dcafaeb196] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:00:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:00:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:00:08 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:00:08 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=25.271316528320312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:00:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:00:09 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:00:09 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:00:09 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:00:09 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:00:09 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:00:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:00:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:00:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:00:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:00:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:00:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:00:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:00:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:00:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:00:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:00:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:00:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:00:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:43 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:53 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:55 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:00:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:59 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:00:59 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:00:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:01:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:01:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:01:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:03 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:01:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:06 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:06 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:01:06 user nova-compute[72405]: INFO nova.compute.claims [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Claim successful on node user
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:01:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.policy [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71fb6c7ca8294adeb2950de39c0a29f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28b951494ad46b7a692b25917b83e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:01:07 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Creating image(s)
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "/opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "/opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "/opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.170s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk 1073741824" returned: 0 in 0.057s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:01:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Successfully created port: 47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Cannot resize image /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'migration_context' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Ensure instance console log exists: /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Successfully updated port: 47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-changed-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.compute.manager [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Refreshing instance network info cache due to event network-changed-47be5173-96ce-48cd-9867-2f2aeb15f2f1. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:01:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Instance network_info: |[{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Refreshing network info cache for port 47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Start _get_guest_xml network_info=[{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:01:09 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:01:09 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-810298187',display_name='tempest-TestStampPattern-server-810298187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-810298187',id=50,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/GRt14w3R0+YGVJnnCregXbWmmMSU99xdvaThxGNJi+LVAMsmJMZqPzftth4VHw5ZH/NaX17kE4CgvgeOqUm0tqu87QtJXvDOhKJ8viJjMWSxQYZoBAmOlW+ae2fqmoQ==',key_name='tempest-TestStampPattern-296773739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28b951494ad46b7a692b25917b83e5b',ramdisk_id='',reservation_id='r-e380t6vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1685280211',owner_user_name='tempest-TestStampPattern-1685280211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:01:07Z,user_data=None,user_id='71fb6c7ca8294adeb2950de39c0a29f8',uuid=3796065e-0c17-419a-af05-48e7417ed56e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converting VIF {"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.objects.instance [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'pci_devices' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:01:09 user nova-compute[72405]:   <uuid>3796065e-0c17-419a-af05-48e7417ed56e</uuid>
Aug 09 00:01:09 user nova-compute[72405]:   <name>instance-00000032</name>
Aug 09 00:01:09 user nova-compute[72405]:   <memory>524288</memory>
Aug 09 00:01:09 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 09 00:01:09 user nova-compute[72405]:   <metadata>
Aug 09 00:01:09 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:01:09 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 09 00:01:09 user nova-compute[72405]:       <nova:name>tempest-TestStampPattern-server-810298187</nova:name>
Aug 09 00:01:09 user nova-compute[72405]:       <nova:creationTime>2023-08-09 00:01:09</nova:creationTime>
Aug 09 00:01:09 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 09 00:01:09 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:01:09 user nova-compute[72405]:       </nova:flavor>
Aug 09 00:01:09 user nova-compute[72405]:       <nova:owner>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:user uuid="71fb6c7ca8294adeb2950de39c0a29f8">tempest-TestStampPattern-1685280211-project-member</nova:user>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:project uuid="d28b951494ad46b7a692b25917b83e5b">tempest-TestStampPattern-1685280211</nova:project>
Aug 09 00:01:09 user nova-compute[72405]:       </nova:owner>
Aug 09 00:01:09 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 09 00:01:09 user nova-compute[72405]:       <nova:ports>
Aug 09 00:01:09 user nova-compute[72405]:         <nova:port uuid="47be5173-96ce-48cd-9867-2f2aeb15f2f1">
Aug 09 00:01:09 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 00:01:09 user nova-compute[72405]:         </nova:port>
Aug 09 00:01:09 user nova-compute[72405]:       </nova:ports>
Aug 09 00:01:09 user nova-compute[72405]:     </nova:instance>
Aug 09 00:01:09 user nova-compute[72405]:   </metadata>
Aug 09 00:01:09 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 09 00:01:09 user nova-compute[72405]:     <system>
Aug 09 00:01:09 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:01:09 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:01:09 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 09 00:01:09 user nova-compute[72405]:       <entry name="serial">3796065e-0c17-419a-af05-48e7417ed56e</entry>
Aug 09 00:01:09 user nova-compute[72405]:       <entry name="uuid">3796065e-0c17-419a-af05-48e7417ed56e</entry>
Aug 09 00:01:09 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:01:09 user nova-compute[72405]:     </system>
Aug 09 00:01:09 user nova-compute[72405]:   </sysinfo>
Aug 09 00:01:09 user nova-compute[72405]:   <os>
Aug 09 00:01:09 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:01:09 user nova-compute[72405]:     <boot dev="hd"/>
Aug 09 00:01:09 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 09 00:01:09 user nova-compute[72405]:   </os>
Aug 09 00:01:09 user nova-compute[72405]:   <features>
Aug 09 00:01:09 user nova-compute[72405]:     <acpi/>
Aug 09 00:01:09 user nova-compute[72405]:     <apic/>
Aug 09 00:01:09 user nova-compute[72405]:     <vmcoreinfo/>
Aug 09 00:01:09 user nova-compute[72405]:   </features>
Aug 09 00:01:09 user nova-compute[72405]:   <clock offset="utc">
Aug 09 00:01:09 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:01:09 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:01:09 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 09 00:01:09 user nova-compute[72405]:   </clock>
Aug 09 00:01:09 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 09 00:01:09 user nova-compute[72405]:     <model>Nehalem</model>
Aug 09 00:01:09 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:01:09 user nova-compute[72405]:   </cpu>
Aug 09 00:01:09 user nova-compute[72405]:   <devices>
Aug 09 00:01:09 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 09 00:01:09 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:01:09 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk"/>
Aug 09 00:01:09 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 09 00:01:09 user nova-compute[72405]:     </disk>
Aug 09 00:01:09 user nova-compute[72405]:     <interface type="ethernet">
Aug 09 00:01:09 user nova-compute[72405]:       <mac address="fa:16:3e:08:2e:2d"/>
Aug 09 00:01:09 user nova-compute[72405]:       <model type="virtio"/>
Aug 09 00:01:09 user nova-compute[72405]:       <mtu size="1442"/>
Aug 09 00:01:09 user nova-compute[72405]:       <target dev="tap47be5173-96"/>
Aug 09 00:01:09 user nova-compute[72405]:     </interface>
Aug 09 00:01:09 user nova-compute[72405]:     <serial type="pty">
Aug 09 00:01:09 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/console.log" append="off"/>
Aug 09 00:01:09 user nova-compute[72405]:     </serial>
Aug 09 00:01:09 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:01:09 user nova-compute[72405]:     <video>
Aug 09 00:01:09 user nova-compute[72405]:       <model type="virtio"/>
Aug 09 00:01:09 user nova-compute[72405]:     </video>
Aug 09 00:01:09 user nova-compute[72405]:     <rng model="virtio">
Aug 09 00:01:09 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:01:09 user nova-compute[72405]:     </rng>
Aug 09 00:01:09 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:01:09 user nova-compute[72405]:     <memballoon model="virtio">
Aug 09 00:01:09 user nova-compute[72405]:       <stats period="10"/>
Aug 09 00:01:09 user nova-compute[72405]:     </memballoon>
Aug 09 00:01:09 user nova-compute[72405]:   </devices>
Aug 09 00:01:09 user nova-compute[72405]: </domain>
Aug 09 00:01:09 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-810298187',display_name='tempest-TestStampPattern-server-810298187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-810298187',id=50,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/GRt14w3R0+YGVJnnCregXbWmmMSU99xdvaThxGNJi+LVAMsmJMZqPzftth4VHw5ZH/NaX17kE4CgvgeOqUm0tqu87QtJXvDOhKJ8viJjMWSxQYZoBAmOlW+ae2fqmoQ==',key_name='tempest-TestStampPattern-296773739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28b951494ad46b7a692b25917b83e5b',ramdisk_id='',reservation_id='r-e380t6vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1685280211',owner_user_name='tempest-TestStampPattern-1685280211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:01:07Z,user_data=None,user_id='71fb6c7ca8294adeb2950de39c0a29f8',uuid=3796065e-0c17-419a-af05-48e7417ed56e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converting VIF {"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG os_vif [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47be5173-96, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47be5173-96, col_values=(('external_ids', {'iface-id': '47be5173-96ce-48cd-9867-2f2aeb15f2f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:2e:2d', 'vm-uuid': '3796065e-0c17-419a-af05-48e7417ed56e'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:09 user nova-compute[72405]: INFO os_vif [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96')
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No VIF found with MAC fa:16:3e:08:2e:2d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated VIF entry in instance network info cache for port 47be5173-96ce-48cd-9867-2f2aeb15f2f1. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG nova.network.neutron [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-3f30f53f-21d8-4c3c-8290-7eb2cdaee7a6 req-9f5392a2-2f8a-4070-9063-d879f84d8cee service nova] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:01:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-887f82a9-3e5c-477c-9640-0a944e20f343 req-e1274a02-1f8a-4816-9fe1-de5318905cc0 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-887f82a9-3e5c-477c-9640-0a944e20f343 req-e1274a02-1f8a-4816-9fe1-de5318905cc0 service nova] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-887f82a9-3e5c-477c-9640-0a944e20f343 req-e1274a02-1f8a-4816-9fe1-de5318905cc0 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-887f82a9-3e5c-477c-9640-0a944e20f343 req-e1274a02-1f8a-4816-9fe1-de5318905cc0 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-887f82a9-3e5c-477c-9640-0a944e20f343 req-e1274a02-1f8a-4816-9fe1-de5318905cc0 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] No waiting events found dispatching network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:01:10 user nova-compute[72405]: WARNING nova.compute.manager [req-887f82a9-3e5c-477c-9640-0a944e20f343 req-e1274a02-1f8a-4816-9fe1-de5318905cc0 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received unexpected event network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 for instance with vm_state building and task_state spawning.
Aug 09 00:01:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:01:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539272.613214, 3796065e-0c17-419a-af05-48e7417ed56e => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:01:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] VM Resumed (Lifecycle Event)
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:01:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Instance spawned successfully.
Aug 09 00:01:12 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:01:12 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.260074615478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:01:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539272.6145494, 3796065e-0c17-419a-af05-48e7417ed56e => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:01:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] VM Started (Lifecycle Event)
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-578a4d21-0cab-4811-b575-fd1c00e6b52e req-ad5b4604-0580-4daf-a721-5c9aa2f29ca1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-578a4d21-0cab-4811-b575-fd1c00e6b52e req-ad5b4604-0580-4daf-a721-5c9aa2f29ca1 service nova] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-578a4d21-0cab-4811-b575-fd1c00e6b52e req-ad5b4604-0580-4daf-a721-5c9aa2f29ca1 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-578a4d21-0cab-4811-b575-fd1c00e6b52e req-ad5b4604-0580-4daf-a721-5c9aa2f29ca1 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-578a4d21-0cab-4811-b575-fd1c00e6b52e req-ad5b4604-0580-4daf-a721-5c9aa2f29ca1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] No waiting events found dispatching network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:01:12 user nova-compute[72405]: WARNING nova.compute.manager [req-578a4d21-0cab-4811-b575-fd1c00e6b52e req-ad5b4604-0580-4daf-a721-5c9aa2f29ca1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received unexpected event network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 for instance with vm_state building and task_state spawning.
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:01:12 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:01:12 user nova-compute[72405]: INFO nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:01:12 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:01:13 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:01:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:13 user nova-compute[72405]: INFO nova.compute.manager [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Took 6.13 seconds to build instance.
Aug 09 00:01:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-bc478b40-3e15-4b4d-942d-14a0f648adef tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.349s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:01:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:01:57 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:01:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:02:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:02:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:02:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:02:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:02:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:02:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:02:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:02:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:02:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:12 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:02:13 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:02:13 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.231124877929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:02:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:02:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:02:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-changed-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:02:58 user nova-compute[72405]: DEBUG nova.compute.manager [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Refreshing instance network info cache due to event network-changed-47be5173-96ce-48cd-9867-2f2aeb15f2f1. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:02:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:02:58 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:02:58 user nova-compute[72405]: DEBUG nova.network.neutron [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Refreshing network info cache for port 47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated VIF entry in instance network info cache for port 47be5173-96ce-48cd-9867-2f2aeb15f2f1. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG nova.objects.instance [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'flavor' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-be9a6dfd-1462-4fd9-9b66-7e7fea80b647 req-015e2893-ca76-4caf-a6d2-04c5f99d611a service nova] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:02:59 user nova-compute[72405]: INFO nova.compute.manager [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Attaching volume 88b534c8-feb4-4062-975d-bdcab5c553ba to /dev/vdb
Aug 09 00:02:59 user nova-compute[72405]: DEBUG os_brick.utils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[856cff5d-7779-4578-88e2-e6aeed67edc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de2f6cb-4160-457f-a305-9877b552f11a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb35e7-8797-44b7-8182-89d1d0210a53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7fe171-b62f-4e98-942b-5cd2dfd701b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:02:59 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:02:59 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb5353-53a5-4c83-81b9-5d933f1e3843]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG os_brick.utils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating existing volume attachment record: c722c486-410a-4afe-8fa8-d086dc5bfefe {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:02:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:03:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:03:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:03:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:03:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:03:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:03:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFsZGjuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:03:07 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:03:07 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:03:07 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34c413-aeed-470e-bf33-4a7ed55f8151]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:03:07 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24900dc4-fe11-4703-86fb-ce9118623fc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba] added
Aug 09 00:03:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b274df8-9513-4a21-b8c0-9ae94e5ba250]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576358e-b36e-476a-9232-d72aee3492fe]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFsZGjuR {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFsZGjuR" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c17ffa-dc0d-4a05-9242-1806cccefa11]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFsZGjuR'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2427a402-9063-43e0-b543-9172ecccd0a5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9572ba8-f9e9-42bc-a332-622b0a976858]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:03:07 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:03:07 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:03:07 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:03:07 user nova-compute[72405]: 
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[248dc926-9275-497d-a45d-57a76171b923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260]
Aug 09 00:03:07 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260] successful.
Aug 09 00:03:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cbe11e-9769-45ea-a0b9-eabc83b5b645]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20148fd-dbfc-4c1c-909b-45fbd6b9cb48]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba (non-flash)
Aug 09 00:03:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba (non-flash)
Aug 09 00:03:07 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994b99f-6092-4b83-a024-5e39889954cc]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:03:07 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFsZGjuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23562346131353536', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562346131353536', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'flavor' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:03:08 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:03:08 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:03:08 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:03:08 user nova-compute[72405]:   <serial>88b534c8-feb4-4062-975d-bdcab5c553ba</serial>
Aug 09 00:03:08 user nova-compute[72405]: </disk>
Aug 09 00:03:08 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:03:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No VIF found with MAC fa:16:3e:08:2e:2d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:03:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-37c4687b-ddb2-4a0f-a76d-bc4061c74d6c tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.681s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:03:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:03:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:03:10 user nova-compute[72405]: INFO nova.compute.manager [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Detaching volume 88b534c8-feb4-4062-975d-bdcab5c553ba
Aug 09 00:03:10 user nova-compute[72405]: INFO nova.virt.block_device [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Attempting to driver detach volume 88b534c8-feb4-4062-975d-bdcab5c553ba from mountpoint /dev/vdb
Aug 09 00:03:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Attempting to detach device vdb from instance 3796065e-0c17-419a-af05-48e7417ed56e from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:03:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:03:10 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:03:10 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:03:10 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:03:10 user nova-compute[72405]:   <serial>88b534c8-feb4-4062-975d-bdcab5c553ba</serial>
Aug 09 00:03:10 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:03:10 user nova-compute[72405]: </disk>
Aug 09 00:03:10 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:03:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully detached device vdb from instance 3796065e-0c17-419a-af05-48e7417ed56e from the persistent domain config.
Aug 09 00:03:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3796065e-0c17-419a-af05-48e7417ed56e from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:03:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:03:10 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:03:10 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:03:10 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:03:10 user nova-compute[72405]:   <serial>88b534c8-feb4-4062-975d-bdcab5c553ba</serial>
Aug 09 00:03:10 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:03:10 user nova-compute[72405]: </disk>
Aug 09 00:03:10 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691539391.3222342, 3796065e-0c17-419a-af05-48e7417ed56e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:03:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully detached device vdb from instance 3796065e-0c17-419a-af05-48e7417ed56e from the live domain config.
Aug 09 00:03:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFsZGjuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:03:11 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033f4be-ad8e-4c9c-b3ac-2237fe4096fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef5a684-76ab-4062-8f6c-b5a0d771730f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba (non-flash)
Aug 09 00:03:11 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba (non-flash)
Aug 09 00:03:11 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54e60550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e45a903-5026-4a83-b85d-e583ad52778c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e07ab-c536-4fc2-a15b-84414af72099]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[da394501-a4c2-487f-8e91-911554c10c26]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a71dc-6952-442e-871e-eef4dabaf80c]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[188475c9-1deb-45b7-b1ac-8fe4b1d429b3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e99164c-c1b2-4a5d-8aba-44252d90d751]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260]
Aug 09 00:03:11 user nova-compute[72405]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba, portal: 172.16.0.220,3260] successful.
Aug 09 00:03:11 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88b534c8-feb4-4062-975d-bdcab5c553ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e9e39e-f61b-464e-bf5c-ea18535b2023]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] <== disconnect_volume: return (264ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:03:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:03:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'flavor' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:03:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-a88bcacb-a093-451c-80bb-c20ede61f409 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:03:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:15 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:03:15 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.23004913330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:03:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:03:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:03:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:03:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:03:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:03:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:03:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:03:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:03:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:03:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:03:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:03:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:03:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:03:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:03:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:03:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:03:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:03:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 00:03:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 00:03:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:04:01 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 00:04:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:04:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:04:08 user nova-compute[72405]: INFO nova.compute.manager [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] instance snapshotting
Aug 09 00:04:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Beginning live snapshot process
Aug 09 00:04:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json -f qcow2 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.131s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpju1nsei6/b581e2dfd5c546fa93a4bdce2499d3e6.delta 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpju1nsei6/b581e2dfd5c546fa93a4bdce2499d3e6.delta 1073741824" returned: 0 in 0.052s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:09 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 00:04:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:04:10 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72405) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:04:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 00:04:10 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:04:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpju1nsei6/b581e2dfd5c546fa93a4bdce2499d3e6.delta /opt/stack/data/nova/instances/snapshots/tmpju1nsei6/b581e2dfd5c546fa93a4bdce2499d3e6 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:10 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpju1nsei6/b581e2dfd5c546fa93a4bdce2499d3e6.delta /opt/stack/data/nova/instances/snapshots/tmpju1nsei6/b581e2dfd5c546fa93a4bdce2499d3e6" returned: 0 in 0.310s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:10 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Snapshot extracted, beginning image upload
Aug 09 00:04:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:13 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Snapshot image upload complete
Aug 09 00:04:13 user nova-compute[72405]: INFO nova.compute.manager [None req-ba5df98d-ec0a-4ff2-8885-ff740052fba6 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Took 4.74 seconds to snapshot the instance on the hypervisor.
Aug 09 00:04:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:14 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:15 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:04:15 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.18036651611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.161s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:15 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:04:15 user nova-compute[72405]: INFO nova.compute.claims [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Claim successful on node user
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:04:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.policy [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71fb6c7ca8294adeb2950de39c0a29f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28b951494ad46b7a692b25917b83e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:04:16 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Creating image(s)
Aug 09 00:04:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "/opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "/opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "/opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "e82c2c624a1ef8ad4673460df7adc17969505175" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "e82c2c624a1ef8ad4673460df7adc17969505175" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.part --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Successfully created port: 6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.part --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG nova.virt.images [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] dd6551cc-687a-43f1-a030-fc70e4baf20f was qcow2, converting to raw {{(pid=72405) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG nova.privsep.utils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72405) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.part /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.converted {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.part /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.converted" returned: 0 in 0.420s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.converted --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "e82c2c624a1ef8ad4673460df7adc17969505175" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.594s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175 --force-share --output=json" returned: 0 in 0.130s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "e82c2c624a1ef8ad4673460df7adc17969505175" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "e82c2c624a1ef8ad4673460df7adc17969505175" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Successfully updated port: 6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-changed-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.compute.manager [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Refreshing instance network info cache due to event network-changed-6385f780-8681-4efa-8959-f49bf4baf05e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] Acquiring lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] Acquired lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Refreshing network info cache for port 6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175 --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175,backing_fmt=raw /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175,backing_fmt=raw /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk 1073741824" returned: 0 in 0.048s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "e82c2c624a1ef8ad4673460df7adc17969505175" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175 --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e82c2c624a1ef8ad4673460df7adc17969505175 --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'migration_context' on Instance uuid 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Ensure instance console log exists: /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.network.neutron [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-7e7401d7-27dd-445f-8f83-9568c00ec939 req-af7608e7-bf14-4771-a185-521ffc0a1fa7 service nova] Releasing lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquired lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:04:18 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.network.neutron [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating instance_info_cache with network_info: [{"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Releasing lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Instance network_info: |[{"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Start _get_guest_xml network_info=[{"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5d3feef66e87d020eedb0aa4b18b0beb',container_format='bare',created_at=2023-08-09T00:04:08Z,direct_url=<?>,disk_format='qcow2',id=dd6551cc-687a-43f1-a030-fc70e4baf20f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1195901348',owner='d28b951494ad46b7a692b25917b83e5b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T00:04:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'dd6551cc-687a-43f1-a030-fc70e4baf20f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:04:19 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:04:19 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5d3feef66e87d020eedb0aa4b18b0beb',container_format='bare',created_at=2023-08-09T00:04:08Z,direct_url=<?>,disk_format='qcow2',id=dd6551cc-687a-43f1-a030-fc70e4baf20f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1195901348',owner='d28b951494ad46b7a692b25917b83e5b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T00:04:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1364086321',display_name='tempest-TestStampPattern-server-1364086321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1364086321',id=51,image_ref='dd6551cc-687a-43f1-a030-fc70e4baf20f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/GRt14w3R0+YGVJnnCregXbWmmMSU99xdvaThxGNJi+LVAMsmJMZqPzftth4VHw5ZH/NaX17kE4CgvgeOqUm0tqu87QtJXvDOhKJ8viJjMWSxQYZoBAmOlW+ae2fqmoQ==',key_name='tempest-TestStampPattern-296773739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28b951494ad46b7a692b25917b83e5b',ramdisk_id='',reservation_id='r-7xgg31fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3796065e-0c17-419a-af05-48e7417ed56e',image_min_disk='1',image_min_ram='0',image_owner_id='d28b951494ad46b7a692b25917b83e5b',image_owner_project_name='tempest-TestStampPattern-1685280211',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1685280211-project-member',image_user_id='71fb6c7ca8294adeb2950de39c0a29f8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1685280211',owner_user_name='tempest-TestStampPattern-1685280211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:04:16Z,user_data=None,user_id='71fb6c7ca8294adeb2950de39c0a29f8',uuid=83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converting VIF {"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.objects.instance [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'pci_devices' on Instance uuid 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:04:19 user nova-compute[72405]:   <uuid>83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e</uuid>
Aug 09 00:04:19 user nova-compute[72405]:   <name>instance-00000033</name>
Aug 09 00:04:19 user nova-compute[72405]:   <memory>524288</memory>
Aug 09 00:04:19 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 09 00:04:19 user nova-compute[72405]:   <metadata>
Aug 09 00:04:19 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:04:19 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 09 00:04:19 user nova-compute[72405]:       <nova:name>tempest-TestStampPattern-server-1364086321</nova:name>
Aug 09 00:04:19 user nova-compute[72405]:       <nova:creationTime>2023-08-09 00:04:19</nova:creationTime>
Aug 09 00:04:19 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 09 00:04:19 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:04:19 user nova-compute[72405]:       </nova:flavor>
Aug 09 00:04:19 user nova-compute[72405]:       <nova:owner>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:user uuid="71fb6c7ca8294adeb2950de39c0a29f8">tempest-TestStampPattern-1685280211-project-member</nova:user>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:project uuid="d28b951494ad46b7a692b25917b83e5b">tempest-TestStampPattern-1685280211</nova:project>
Aug 09 00:04:19 user nova-compute[72405]:       </nova:owner>
Aug 09 00:04:19 user nova-compute[72405]:       <nova:root type="image" uuid="dd6551cc-687a-43f1-a030-fc70e4baf20f"/>
Aug 09 00:04:19 user nova-compute[72405]:       <nova:ports>
Aug 09 00:04:19 user nova-compute[72405]:         <nova:port uuid="6385f780-8681-4efa-8959-f49bf4baf05e">
Aug 09 00:04:19 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 00:04:19 user nova-compute[72405]:         </nova:port>
Aug 09 00:04:19 user nova-compute[72405]:       </nova:ports>
Aug 09 00:04:19 user nova-compute[72405]:     </nova:instance>
Aug 09 00:04:19 user nova-compute[72405]:   </metadata>
Aug 09 00:04:19 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 09 00:04:19 user nova-compute[72405]:     <system>
Aug 09 00:04:19 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:04:19 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:04:19 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 09 00:04:19 user nova-compute[72405]:       <entry name="serial">83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e</entry>
Aug 09 00:04:19 user nova-compute[72405]:       <entry name="uuid">83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e</entry>
Aug 09 00:04:19 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:04:19 user nova-compute[72405]:     </system>
Aug 09 00:04:19 user nova-compute[72405]:   </sysinfo>
Aug 09 00:04:19 user nova-compute[72405]:   <os>
Aug 09 00:04:19 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:04:19 user nova-compute[72405]:     <boot dev="hd"/>
Aug 09 00:04:19 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 09 00:04:19 user nova-compute[72405]:   </os>
Aug 09 00:04:19 user nova-compute[72405]:   <features>
Aug 09 00:04:19 user nova-compute[72405]:     <acpi/>
Aug 09 00:04:19 user nova-compute[72405]:     <apic/>
Aug 09 00:04:19 user nova-compute[72405]:     <vmcoreinfo/>
Aug 09 00:04:19 user nova-compute[72405]:   </features>
Aug 09 00:04:19 user nova-compute[72405]:   <clock offset="utc">
Aug 09 00:04:19 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:04:19 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:04:19 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 09 00:04:19 user nova-compute[72405]:   </clock>
Aug 09 00:04:19 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 09 00:04:19 user nova-compute[72405]:     <model>Nehalem</model>
Aug 09 00:04:19 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:04:19 user nova-compute[72405]:   </cpu>
Aug 09 00:04:19 user nova-compute[72405]:   <devices>
Aug 09 00:04:19 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 09 00:04:19 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:04:19 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk"/>
Aug 09 00:04:19 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 09 00:04:19 user nova-compute[72405]:     </disk>
Aug 09 00:04:19 user nova-compute[72405]:     <interface type="ethernet">
Aug 09 00:04:19 user nova-compute[72405]:       <mac address="fa:16:3e:aa:e2:e9"/>
Aug 09 00:04:19 user nova-compute[72405]:       <model type="virtio"/>
Aug 09 00:04:19 user nova-compute[72405]:       <mtu size="1442"/>
Aug 09 00:04:19 user nova-compute[72405]:       <target dev="tap6385f780-86"/>
Aug 09 00:04:19 user nova-compute[72405]:     </interface>
Aug 09 00:04:19 user nova-compute[72405]:     <serial type="pty">
Aug 09 00:04:19 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/console.log" append="off"/>
Aug 09 00:04:19 user nova-compute[72405]:     </serial>
Aug 09 00:04:19 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:04:19 user nova-compute[72405]:     <video>
Aug 09 00:04:19 user nova-compute[72405]:       <model type="virtio"/>
Aug 09 00:04:19 user nova-compute[72405]:     </video>
Aug 09 00:04:19 user nova-compute[72405]:     <rng model="virtio">
Aug 09 00:04:19 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:04:19 user nova-compute[72405]:     </rng>
Aug 09 00:04:19 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:04:19 user nova-compute[72405]:     <memballoon model="virtio">
Aug 09 00:04:19 user nova-compute[72405]:       <stats period="10"/>
Aug 09 00:04:19 user nova-compute[72405]:     </memballoon>
Aug 09 00:04:19 user nova-compute[72405]:   </devices>
Aug 09 00:04:19 user nova-compute[72405]: </domain>
Aug 09 00:04:19 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1364086321',display_name='tempest-TestStampPattern-server-1364086321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1364086321',id=51,image_ref='dd6551cc-687a-43f1-a030-fc70e4baf20f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/GRt14w3R0+YGVJnnCregXbWmmMSU99xdvaThxGNJi+LVAMsmJMZqPzftth4VHw5ZH/NaX17kE4CgvgeOqUm0tqu87QtJXvDOhKJ8viJjMWSxQYZoBAmOlW+ae2fqmoQ==',key_name='tempest-TestStampPattern-296773739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28b951494ad46b7a692b25917b83e5b',ramdisk_id='',reservation_id='r-7xgg31fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3796065e-0c17-419a-af05-48e7417ed56e',image_min_disk='1',image_min_ram='0',image_owner_id='d28b951494ad46b7a692b25917b83e5b',image_owner_project_name='tempest-TestStampPattern-1685280211',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1685280211-project-member',image_user_id='71fb6c7ca8294adeb2950de39c0a29f8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1685280211',owner_user_name='tempest-TestStampPattern-1685280211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:04:16Z,user_data=None,user_id='71fb6c7ca8294adeb2950de39c0a29f8',uuid=83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converting VIF {"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG os_vif [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6385f780-86, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6385f780-86, col_values=(('external_ids', {'iface-id': '6385f780-8681-4efa-8959-f49bf4baf05e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:e2:e9', 'vm-uuid': '83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:19 user nova-compute[72405]: INFO os_vif [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86')
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:04:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No VIF found with MAC fa:16:3e:aa:e2:e9, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-2a700cf7-fa1e-4acb-9846-263eb5f2a565 req-bd55c06c-2d99-4cd8-9810-9980089d3525 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2a700cf7-fa1e-4acb-9846-263eb5f2a565 req-bd55c06c-2d99-4cd8-9810-9980089d3525 service nova] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2a700cf7-fa1e-4acb-9846-263eb5f2a565 req-bd55c06c-2d99-4cd8-9810-9980089d3525 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2a700cf7-fa1e-4acb-9846-263eb5f2a565 req-bd55c06c-2d99-4cd8-9810-9980089d3525 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:20 user nova-compute[72405]: DEBUG nova.compute.manager [req-2a700cf7-fa1e-4acb-9846-263eb5f2a565 req-bd55c06c-2d99-4cd8-9810-9980089d3525 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] No waiting events found dispatching network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:04:20 user nova-compute[72405]: WARNING nova.compute.manager [req-2a700cf7-fa1e-4acb-9846-263eb5f2a565 req-bd55c06c-2d99-4cd8-9810-9980089d3525 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received unexpected event network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e for instance with vm_state building and task_state spawning.
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539462.5577898, 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] VM Resumed (Lifecycle Event)
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Instance spawned successfully.
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539462.5591698, 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] VM Started (Lifecycle Event)
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:04:22 user nova-compute[72405]: INFO nova.compute.manager [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Took 7.33 seconds to build instance.
Aug 09 00:04:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-8617e4c9-197f-4131-b5fd-8bf566739f84 tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.433s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-9f094fb0-7e5d-482d-861d-8e2a0e9d149e req-e1d5a597-3736-425c-a3fa-65ca68b99d43 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f094fb0-7e5d-482d-861d-8e2a0e9d149e req-e1d5a597-3736-425c-a3fa-65ca68b99d43 service nova] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f094fb0-7e5d-482d-861d-8e2a0e9d149e req-e1d5a597-3736-425c-a3fa-65ca68b99d43 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9f094fb0-7e5d-482d-861d-8e2a0e9d149e req-e1d5a597-3736-425c-a3fa-65ca68b99d43 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:04:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-9f094fb0-7e5d-482d-861d-8e2a0e9d149e req-e1d5a597-3736-425c-a3fa-65ca68b99d43 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] No waiting events found dispatching network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:04:22 user nova-compute[72405]: WARNING nova.compute.manager [req-9f094fb0-7e5d-482d-861d-8e2a0e9d149e req-e1d5a597-3736-425c-a3fa-65ca68b99d43 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received unexpected event network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e for instance with vm_state active and task_state None.
Aug 09 00:04:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:04:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:04:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:04:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:04:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:04:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:05:02 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:05:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:05:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:05:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:05:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:05:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:07 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:05:12 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:05:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:05:17 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:05:17 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.083274841308594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:05:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:05:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:05:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:05:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:05:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:05:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:05:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:05:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:06:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:06:02 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:06:02 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:06:03 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating instance_info_cache with network_info: [{"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:06:03 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:06:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:06:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:06:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:06:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-changed-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG nova.compute.manager [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Refreshing instance network info cache due to event network-changed-6385f780-8681-4efa-8959-f49bf4baf05e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] Acquiring lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] Acquired lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Refreshing network info cache for port 6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updated VIF entry in instance network info cache for port 6385f780-8681-4efa-8959-f49bf4baf05e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG nova.network.neutron [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating instance_info_cache with network_info: [{"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'flavor' on Instance uuid 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-74de9dc4-4300-4590-90df-7f193f34c73e req-4c81c0b0-a621-4222-bc77-fc0bb0d9763c service nova] Releasing lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:06:07 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:06:07 user nova-compute[72405]: INFO nova.compute.manager [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Attaching volume 8664543c-f31c-402b-8e68-99d009646717 to /dev/vdb
Aug 09 00:06:08 user nova-compute[72405]: DEBUG os_brick.utils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a66890e-d5ae-4be1-9bff-5e0e0bedf1f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6495271-dd33-4097-b779-7465eee56ea3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d993c74-5c1c-4e98-9636-6af0beb21495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7745d83d-eb30-4ac0-ae48-551bc99d0ef0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:06:08 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73df5d1-bced-41bd-bf3d-f926dfd59338]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG os_brick.utils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating existing volume attachment record: 4085ae1a-eb6a-47d8-bfe8-9842a38f8100 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:06:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:14 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhIZgWGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:06:15 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:06:15 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:06:15 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c40f9-9044-4f5c-b8e4-eec3a9b9dcb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:06:15 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b03e88-516a-4b28-aee2-39372abf48b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717] added
Aug 09 00:06:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[05297748-ba86-4e3e-9936-50bae190889d]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee26c93-1bb3-471f-9a3a-9e9d185a5c1b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhIZgWGc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhIZgWGc" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1cca55-6ca9-4862-a176-3aff726f52f1]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhIZgWGc'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab50c8c-e223-46f5-8170-fdb342e77af4]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d402f69d-e045-4a0a-b2e2-916c718ea05d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:06:15 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:06:15 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:06:15 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:06:15 user nova-compute[72405]: 
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d1e8b7-0914-46e3-9784-941a7396fc66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260]
Aug 09 00:06:15 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260] successful.
Aug 09 00:06:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f220a1e4-8144-4697-8c1c-0937c473248c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb84b97-65a8-4c83-95fa-3d19ec2604ed]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 (non-flash)
Aug 09 00:06:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 (non-flash)
Aug 09 00:06:15 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:06:15 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:16 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:16 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d593b20e-7ee7-46d9-9436-72fe69271376]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:16 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhIZgWGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23335336462643864', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335336462643864', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'flavor' on Instance uuid 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:06:17 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:06:17 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:06:17 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:06:17 user nova-compute[72405]:   <serial>8664543c-f31c-402b-8e68-99d009646717</serial>
Aug 09 00:06:17 user nova-compute[72405]: </disk>
Aug 09 00:06:17 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] No VIF found with MAC fa:16:3e:aa:e2:e9, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6551d2c3-0664-4520-8d47-59821d4d2e0f tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.664s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:06:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:06:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.082355499267578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:06:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:06:19 user nova-compute[72405]: INFO nova.compute.manager [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Detaching volume 8664543c-f31c-402b-8e68-99d009646717
Aug 09 00:06:19 user nova-compute[72405]: INFO nova.virt.block_device [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Attempting to driver detach volume 8664543c-f31c-402b-8e68-99d009646717 from mountpoint /dev/vdb
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Attempting to detach device vdb from instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:06:19 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:06:19 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:06:19 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:06:19 user nova-compute[72405]:   <serial>8664543c-f31c-402b-8e68-99d009646717</serial>
Aug 09 00:06:19 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:06:19 user nova-compute[72405]: </disk>
Aug 09 00:06:19 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:06:19 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully detached device vdb from instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e from the persistent domain config.
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:06:19 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:06:19 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:06:19 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:06:19 user nova-compute[72405]:   <serial>8664543c-f31c-402b-8e68-99d009646717</serial>
Aug 09 00:06:19 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:06:19 user nova-compute[72405]: </disk>
Aug 09 00:06:19 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691539579.9756575, 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:06:19 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully detached device vdb from instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e from the live domain config.
Aug 09 00:06:19 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhIZgWGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:06:19 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:06:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:06:19 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c1d855-c1a8-43fb-b96c-eaeb1ca02214]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd1d3e7-3711-40d5-9b43-3becb02f8031]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 (non-flash)
Aug 09 00:06:20 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 (non-flash)
Aug 09 00:06:20 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb982040d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[31505226-2b45-4186-962e-51540a568ba3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd760d3-6ee0-4cac-b977-af440b77be64]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[955bf50d-f709-4052-9c85-4aaa6188382c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c3f280-dbb2-43f0-8274-e1d0065259fe]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63d75f4-376a-4c85-b725-a409b1b94cc5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[364da9cc-0967-441c-96ab-59833e44f041]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260]
Aug 09 00:06:20 user nova-compute[72405]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717, portal: 172.16.0.220,3260] successful.
Aug 09 00:06:20 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8664543c-f31c-402b-8e68-99d009646717 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbe18d-bbf0-4d7b-84e7-1e2653f67e64]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] <== disconnect_volume: return (276ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:06:20 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'flavor' on Instance uuid 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:06:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ad706bf0-4ddc-4d0c-8004-e7698d11116d tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.577s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:06:24 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:29 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:34 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:06:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:06:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:06:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:06:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:06:39 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:44 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:06:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:06:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:06:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:06:49 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:06:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:06:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:06:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:06:54 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:06:59 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:07:04 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:07:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:09 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-changed-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Refreshing instance network info cache due to event network-changed-6385f780-8681-4efa-8959-f49bf4baf05e. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] Acquiring lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] Acquired lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Refreshing network info cache for port 6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:10 user nova-compute[72405]: INFO nova.compute.manager [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Terminating instance
Aug 09 00:07:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updated VIF entry in instance network info cache for port 6385f780-8681-4efa-8959-f49bf4baf05e. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG nova.network.neutron [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating instance_info_cache with network_info: [{"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:07:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-cc32d004-55cd-4e11-a944-ad52b68fe0ac req-18672bd2-2caa-43f7-9a2c-14efdf86afb9 service nova] Releasing lock "refresh_cache-83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-83ba02bc-77c8-47c1-b886-a29852ba188a req-365cb708-8e4e-4240-b9c4-26fd4de56c86 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-vif-unplugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-83ba02bc-77c8-47c1-b886-a29852ba188a req-365cb708-8e4e-4240-b9c4-26fd4de56c86 service nova] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-83ba02bc-77c8-47c1-b886-a29852ba188a req-365cb708-8e4e-4240-b9c4-26fd4de56c86 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-83ba02bc-77c8-47c1-b886-a29852ba188a req-365cb708-8e4e-4240-b9c4-26fd4de56c86 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-83ba02bc-77c8-47c1-b886-a29852ba188a req-365cb708-8e4e-4240-b9c4-26fd4de56c86 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] No waiting events found dispatching network-vif-unplugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-83ba02bc-77c8-47c1-b886-a29852ba188a req-365cb708-8e4e-4240-b9c4-26fd4de56c86 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-vif-unplugged-6385f780-8681-4efa-8959-f49bf4baf05e for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:07:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Instance destroyed successfully.
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'resources' on Instance uuid 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1364086321',display_name='tempest-TestStampPattern-server-1364086321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1364086321',id=51,image_ref='dd6551cc-687a-43f1-a030-fc70e4baf20f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/GRt14w3R0+YGVJnnCregXbWmmMSU99xdvaThxGNJi+LVAMsmJMZqPzftth4VHw5ZH/NaX17kE4CgvgeOqUm0tqu87QtJXvDOhKJ8viJjMWSxQYZoBAmOlW+ae2fqmoQ==',key_name='tempest-TestStampPattern-296773739',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d28b951494ad46b7a692b25917b83e5b',ramdisk_id='',reservation_id='r-7xgg31fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3796065e-0c17-419a-af05-48e7417ed56e',image_min_disk='1',image_min_ram='0',image_owner_id='d28b951494ad46b7a692b25917b83e5b',image_owner_project_name='tempest-TestStampPattern-1685280211',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1685280211-project-member',image_user_id='71fb6c7ca8294adeb2950de39c0a29f8',owner_project_name='tempest-TestStampPattern-1685280211',owner_user_name='tempest-TestStampPattern-1685280211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:04:23Z,user_data=None,user_id='71fb6c7ca8294adeb2950de39c0a29f8',uuid=83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converting VIF {"id": "6385f780-8681-4efa-8959-f49bf4baf05e", "address": "fa:16:3e:aa:e2:e9", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6385f780-86", "ovs_interfaceid": "6385f780-8681-4efa-8959-f49bf4baf05e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG os_vif [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6385f780-86, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:11 user nova-compute[72405]: INFO os_vif [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e2:e9,bridge_name='br-int',has_traffic_filtering=True,id=6385f780-8681-4efa-8959-f49bf4baf05e,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6385f780-86')
Aug 09 00:07:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Deleting instance files /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e_del
Aug 09 00:07:11 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Deletion of /opt/stack/data/nova/instances/83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e_del complete
Aug 09 00:07:11 user nova-compute[72405]: INFO nova.compute.manager [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 09 00:07:11 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:07:11 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Took 0.50 seconds to deallocate network for instance.
Aug 09 00:07:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:12 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:07:12 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:07:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:12 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Deleted allocations for instance 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e
Aug 09 00:07:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-31b433d9-5d96-4551-bcf4-8e96f601beed tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.664s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:12 user nova-compute[72405]: DEBUG nova.compute.manager [req-9c953e25-8696-442e-8422-06eb0ba54f66 req-4d018273-944b-4279-89e5-5c8f769183e8 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-vif-deleted-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:07:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-600584c9-de19-42a5-9644-fb1d4b6aa52e req-d473319a-4173-4622-89d8-f1288fa975d9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received event network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:07:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-600584c9-de19-42a5-9644-fb1d4b6aa52e req-d473319a-4173-4622-89d8-f1288fa975d9 service nova] Acquiring lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-600584c9-de19-42a5-9644-fb1d4b6aa52e req-d473319a-4173-4622-89d8-f1288fa975d9 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-600584c9-de19-42a5-9644-fb1d4b6aa52e req-d473319a-4173-4622-89d8-f1288fa975d9 service nova] Lock "83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-600584c9-de19-42a5-9644-fb1d4b6aa52e req-d473319a-4173-4622-89d8-f1288fa975d9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] No waiting events found dispatching network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:07:13 user nova-compute[72405]: WARNING nova.compute.manager [req-600584c9-de19-42a5-9644-fb1d4b6aa52e req-d473319a-4173-4622-89d8-f1288fa975d9 service nova] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Received unexpected event network-vif-plugged-6385f780-8681-4efa-8959-f49bf4baf05e for instance with vm_state deleted and task_state None.
Aug 09 00:07:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:16 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:07:17 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:07:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:07:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.082782745361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance 3796065e-0c17-419a-af05-48e7417ed56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:07:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:07:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691539631.274868, 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:07:26 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] VM Stopped (Lifecycle Event)
Aug 09 00:07:26 user nova-compute[72405]: DEBUG nova.compute.manager [None req-3bfd8bf3-973a-44f0-9043-af4254993d2b None None] [instance: 83b8f2fd-2bff-46a9-906d-1b4b6cf8c00e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:07:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:07:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:07:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:08:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:08:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:08:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:08:04 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:08:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:08:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-changed-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG nova.compute.manager [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Refreshing instance network info cache due to event network-changed-47be5173-96ce-48cd-9867-2f2aeb15f2f1. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] Acquiring lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] Acquired lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Refreshing network info cache for port 47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:11 user nova-compute[72405]: INFO nova.compute.manager [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Terminating instance
Aug 09 00:08:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updated VIF entry in instance network info cache for port 47be5173-96ce-48cd-9867-2f2aeb15f2f1. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.network.neutron [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [{"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9d6e7a51-49d5-4b86-ad86-a5fcc0277ae3 req-a8bbaee6-5f31-4103-8006-2ca5314ac4a9 service nova] Releasing lock "refresh_cache-3796065e-0c17-419a-af05-48e7417ed56e" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:08:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Instance destroyed successfully.
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lazy-loading 'resources' on Instance uuid 3796065e-0c17-419a-af05-48e7417ed56e {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-810298187',display_name='tempest-TestStampPattern-server-810298187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-810298187',id=50,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/GRt14w3R0+YGVJnnCregXbWmmMSU99xdvaThxGNJi+LVAMsmJMZqPzftth4VHw5ZH/NaX17kE4CgvgeOqUm0tqu87QtJXvDOhKJ8viJjMWSxQYZoBAmOlW+ae2fqmoQ==',key_name='tempest-TestStampPattern-296773739',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:01:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d28b951494ad46b7a692b25917b83e5b',ramdisk_id='',reservation_id='r-e380t6vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1685280211',owner_user_name='tempest-TestStampPattern-1685280211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:04:13Z,user_data=None,user_id='71fb6c7ca8294adeb2950de39c0a29f8',uuid=3796065e-0c17-419a-af05-48e7417ed56e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converting VIF {"id": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "address": "fa:16:3e:08:2e:2d", "network": {"id": "347cb1b5-e568-47b3-bbcb-979e381e422d", "bridge": "br-int", "label": "tempest-TestStampPattern-112787417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28b951494ad46b7a692b25917b83e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47be5173-96", "ovs_interfaceid": "47be5173-96ce-48cd-9867-2f2aeb15f2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG os_vif [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47be5173-96, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:12 user nova-compute[72405]: INFO os_vif [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2e:2d,bridge_name='br-int',has_traffic_filtering=True,id=47be5173-96ce-48cd-9867-2f2aeb15f2f1,network=Network(347cb1b5-e568-47b3-bbcb-979e381e422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47be5173-96')
Aug 09 00:08:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Deleting instance files /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e_del
Aug 09 00:08:12 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Deletion of /opt/stack/data/nova/instances/3796065e-0c17-419a-af05-48e7417ed56e_del complete
Aug 09 00:08:12 user nova-compute[72405]: INFO nova.compute.manager [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 00:08:12 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:08:12 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:08:13 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Took 0.46 seconds to deallocate network for instance.
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:13 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Deleted allocations for instance 3796065e-0c17-419a-af05-48e7417ed56e
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-ed11113c-a8ea-41dd-9009-9526887b454a tempest-TestStampPattern-1685280211 tempest-TestStampPattern-1685280211-project-member] Lock "3796065e-0c17-419a-af05-48e7417ed56e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.609s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-vif-unplugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] No waiting events found dispatching network-vif-unplugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:08:13 user nova-compute[72405]: WARNING nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received unexpected event network-vif-unplugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 for instance with vm_state deleted and task_state None.
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] Acquiring lock "3796065e-0c17-419a-af05-48e7417ed56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] Lock "3796065e-0c17-419a-af05-48e7417ed56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] No waiting events found dispatching network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:08:13 user nova-compute[72405]: WARNING nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received unexpected event network-vif-plugged-47be5173-96ce-48cd-9867-2f2aeb15f2f1 for instance with vm_state deleted and task_state None.
Aug 09 00:08:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-1f476f64-edd8-4c4c-a1ae-5debc8d6162e req-55649a79-8bda-479e-8147-5fd07aac7cb1 service nova] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Received event network-vif-deleted-47be5173-96ce-48cd-9867-2f2aeb15f2f1 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:08:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:08:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:08:18 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:08:18 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.207447052001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:08:18 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:08:19 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:08:19 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:08:19 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:08:19 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:08:19 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:08:19 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:08:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:08:27 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691539692.5137315, 3796065e-0c17-419a-af05-48e7417ed56e => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:08:27 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] VM Stopped (Lifecycle Event)
Aug 09 00:08:27 user nova-compute[72405]: DEBUG nova.compute.manager [None req-21c9e928-9d5f-4702-b5c5-d280dd5acf6d None None] [instance: 3796065e-0c17-419a-af05-48e7417ed56e] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:08:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:08:56 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:08:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 00:08:56 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 00:08:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:09:02 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:02 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 00:09:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:09:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:09:05 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:09:05 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:09:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:09:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:09:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:09:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:09:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:12 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:09:20 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:09:20 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:09:20 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.20624542236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:09:20 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:09:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:09:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:09:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:09:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:09:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:09:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:00 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:04 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:06 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:10:07 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:10:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:10:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:10:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Starting instance... {{(pid=72405) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72405) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:10:08 user nova-compute[72405]: INFO nova.compute.claims [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Claim successful on node user
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Start building networks asynchronously for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Allocating IP information in the background. {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] allocate_for_instance() {{(pid=72405) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:10:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Start building block device mappings for instance. {{(pid=72405) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Start spawning the instance on the hypervisor. {{(pid=72405) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Creating instance directory {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:10:08 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Creating image(s)
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "/opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "/opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "/opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:08 user nova-compute[72405]: DEBUG nova.policy [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4500f14af8745128d3e1a35aa8d17b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0d7fa8123d4f7cbc98a6fe877dab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72405) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.167s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.140s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk 1073741824 {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b,backing_fmt=raw /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk 1073741824" returned: 0 in 0.059s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "f7d45b25b50785349c4f4661c765c34d33e56f4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d45b25b50785349c4f4661c765c34d33e56f4b --force-share --output=json" returned: 0 in 0.144s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk. size=1073741824 {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG nova.virt.disk.api [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Cannot resize image /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk to a smaller size. {{(pid=72405) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'migration_context' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Created local disks {{(pid=72405) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Ensure instance console log exists: /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/console.log {{(pid=72405) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Successfully created port: 875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Successfully updated port: 875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Building network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-changed-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG nova.compute.manager [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Refreshing instance network info cache due to event network-changed-875df7c0-d9aa-4062-81cb-118cd0670fb3. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:10:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Instance cache missing network info. {{(pid=72405) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Instance network_info: |[{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72405) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Refreshing network info cache for port 875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Start _get_guest_xml network_info=[{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ed72958c-30b3-4e1d-9bb6-9c0404b96321'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:10:11 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:10:11 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CPU controller missing on host. {{(pid=72405) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.host [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CPU controller found on host. {{(pid=72405) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72405) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-08T23:18:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-08T23:18:50Z,direct_url=<?>,disk_format='qcow2',id=ed72958c-30b3-4e1d-9bb6-9c0404b96321,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='709d55a5d7b94f2b8e6bf80fcfeaf933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-08T23:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Flavor limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Image limits 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Flavor pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Image pref 0:0:0 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Got 1 possible topologies {{(pid=72405) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.hardware [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72405) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-340831079',display_name='tempest-SnapshotDataIntegrityTests-server-340831079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-340831079',id=52,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnHKVkCYD2uspbTyB17LYfwjzbwC+qV0XOc6gYJtlW1/GQQHVb7Y7wR5BfKhVgwhqbimsZ3nn1CrcoGcGkQAaIw1OU5PFdoydxOe/3MHzk4ChTtYMvnB69huZtHhC4DwQ==',key_name='tempest-keypair-380181297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0d7fa8123d4f7cbc98a6fe877dab00',ramdisk_id='',reservation_id='r-6p5h5qy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2101868849',owner_user_name='tempest-SnapshotDataIntegrityTests-2101868849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4500f14af8745128d3e1a35aa8d17b8',uuid=e84eec34-b6d0-4d03-9b75-dc12ed1eeab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72405) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Converting VIF {"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'pci_devices' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:10:11 user nova-compute[72405]:   <uuid>e84eec34-b6d0-4d03-9b75-dc12ed1eeab0</uuid>
Aug 09 00:10:11 user nova-compute[72405]:   <name>instance-00000034</name>
Aug 09 00:10:11 user nova-compute[72405]:   <memory>524288</memory>
Aug 09 00:10:11 user nova-compute[72405]:   <vcpu>1</vcpu>
Aug 09 00:10:11 user nova-compute[72405]:   <metadata>
Aug 09 00:10:11 user nova-compute[72405]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:10:11 user nova-compute[72405]:       <nova:package version="0.0.0"/>
Aug 09 00:10:11 user nova-compute[72405]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-340831079</nova:name>
Aug 09 00:10:11 user nova-compute[72405]:       <nova:creationTime>2023-08-09 00:10:11</nova:creationTime>
Aug 09 00:10:11 user nova-compute[72405]:       <nova:flavor name="m1.tiny">
Aug 09 00:10:11 user nova-compute[72405]:         <nova:memory>512</nova:memory>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:disk>1</nova:disk>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:swap>0</nova:swap>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:10:11 user nova-compute[72405]:       </nova:flavor>
Aug 09 00:10:11 user nova-compute[72405]:       <nova:owner>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:user uuid="c4500f14af8745128d3e1a35aa8d17b8">tempest-SnapshotDataIntegrityTests-2101868849-project-member</nova:user>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:project uuid="de0d7fa8123d4f7cbc98a6fe877dab00">tempest-SnapshotDataIntegrityTests-2101868849</nova:project>
Aug 09 00:10:11 user nova-compute[72405]:       </nova:owner>
Aug 09 00:10:11 user nova-compute[72405]:       <nova:root type="image" uuid="ed72958c-30b3-4e1d-9bb6-9c0404b96321"/>
Aug 09 00:10:11 user nova-compute[72405]:       <nova:ports>
Aug 09 00:10:11 user nova-compute[72405]:         <nova:port uuid="875df7c0-d9aa-4062-81cb-118cd0670fb3">
Aug 09 00:10:11 user nova-compute[72405]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 00:10:11 user nova-compute[72405]:         </nova:port>
Aug 09 00:10:11 user nova-compute[72405]:       </nova:ports>
Aug 09 00:10:11 user nova-compute[72405]:     </nova:instance>
Aug 09 00:10:11 user nova-compute[72405]:   </metadata>
Aug 09 00:10:11 user nova-compute[72405]:   <sysinfo type="smbios">
Aug 09 00:10:11 user nova-compute[72405]:     <system>
Aug 09 00:10:11 user nova-compute[72405]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:10:11 user nova-compute[72405]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:10:11 user nova-compute[72405]:       <entry name="version">0.0.0</entry>
Aug 09 00:10:11 user nova-compute[72405]:       <entry name="serial">e84eec34-b6d0-4d03-9b75-dc12ed1eeab0</entry>
Aug 09 00:10:11 user nova-compute[72405]:       <entry name="uuid">e84eec34-b6d0-4d03-9b75-dc12ed1eeab0</entry>
Aug 09 00:10:11 user nova-compute[72405]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:10:11 user nova-compute[72405]:     </system>
Aug 09 00:10:11 user nova-compute[72405]:   </sysinfo>
Aug 09 00:10:11 user nova-compute[72405]:   <os>
Aug 09 00:10:11 user nova-compute[72405]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:10:11 user nova-compute[72405]:     <boot dev="hd"/>
Aug 09 00:10:11 user nova-compute[72405]:     <smbios mode="sysinfo"/>
Aug 09 00:10:11 user nova-compute[72405]:   </os>
Aug 09 00:10:11 user nova-compute[72405]:   <features>
Aug 09 00:10:11 user nova-compute[72405]:     <acpi/>
Aug 09 00:10:11 user nova-compute[72405]:     <apic/>
Aug 09 00:10:11 user nova-compute[72405]:     <vmcoreinfo/>
Aug 09 00:10:11 user nova-compute[72405]:   </features>
Aug 09 00:10:11 user nova-compute[72405]:   <clock offset="utc">
Aug 09 00:10:11 user nova-compute[72405]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:10:11 user nova-compute[72405]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:10:11 user nova-compute[72405]:     <timer name="hpet" present="no"/>
Aug 09 00:10:11 user nova-compute[72405]:   </clock>
Aug 09 00:10:11 user nova-compute[72405]:   <cpu mode="custom" match="exact">
Aug 09 00:10:11 user nova-compute[72405]:     <model>Nehalem</model>
Aug 09 00:10:11 user nova-compute[72405]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:10:11 user nova-compute[72405]:   </cpu>
Aug 09 00:10:11 user nova-compute[72405]:   <devices>
Aug 09 00:10:11 user nova-compute[72405]:     <disk type="file" device="disk">
Aug 09 00:10:11 user nova-compute[72405]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:10:11 user nova-compute[72405]:       <source file="/opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk"/>
Aug 09 00:10:11 user nova-compute[72405]:       <target dev="vda" bus="virtio"/>
Aug 09 00:10:11 user nova-compute[72405]:     </disk>
Aug 09 00:10:11 user nova-compute[72405]:     <interface type="ethernet">
Aug 09 00:10:11 user nova-compute[72405]:       <mac address="fa:16:3e:c8:3c:6d"/>
Aug 09 00:10:11 user nova-compute[72405]:       <model type="virtio"/>
Aug 09 00:10:11 user nova-compute[72405]:       <mtu size="1442"/>
Aug 09 00:10:11 user nova-compute[72405]:       <target dev="tap875df7c0-d9"/>
Aug 09 00:10:11 user nova-compute[72405]:     </interface>
Aug 09 00:10:11 user nova-compute[72405]:     <serial type="pty">
Aug 09 00:10:11 user nova-compute[72405]:       <log file="/opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/console.log" append="off"/>
Aug 09 00:10:11 user nova-compute[72405]:     </serial>
Aug 09 00:10:11 user nova-compute[72405]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:10:11 user nova-compute[72405]:     <video>
Aug 09 00:10:11 user nova-compute[72405]:       <model type="virtio"/>
Aug 09 00:10:11 user nova-compute[72405]:     </video>
Aug 09 00:10:11 user nova-compute[72405]:     <rng model="virtio">
Aug 09 00:10:11 user nova-compute[72405]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:10:11 user nova-compute[72405]:     </rng>
Aug 09 00:10:11 user nova-compute[72405]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:10:11 user nova-compute[72405]:     <memballoon model="virtio">
Aug 09 00:10:11 user nova-compute[72405]:       <stats period="10"/>
Aug 09 00:10:11 user nova-compute[72405]:     </memballoon>
Aug 09 00:10:11 user nova-compute[72405]:   </devices>
Aug 09 00:10:11 user nova-compute[72405]: </domain>
Aug 09 00:10:11 user nova-compute[72405]:  {{(pid=72405) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-340831079',display_name='tempest-SnapshotDataIntegrityTests-server-340831079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-340831079',id=52,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnHKVkCYD2uspbTyB17LYfwjzbwC+qV0XOc6gYJtlW1/GQQHVb7Y7wR5BfKhVgwhqbimsZ3nn1CrcoGcGkQAaIw1OU5PFdoydxOe/3MHzk4ChTtYMvnB69huZtHhC4DwQ==',key_name='tempest-keypair-380181297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0d7fa8123d4f7cbc98a6fe877dab00',ramdisk_id='',reservation_id='r-6p5h5qy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2101868849',owner_user_name='tempest-SnapshotDataIntegrityTests-2101868849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4500f14af8745128d3e1a35aa8d17b8',uuid=e84eec34-b6d0-4d03-9b75-dc12ed1eeab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Converting VIF {"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG os_vif [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9') {{(pid=72405) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875df7c0-d9, may_exist=True, interface_attrs={}) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap875df7c0-d9, col_values=(('external_ids', {'iface-id': '875df7c0-d9aa-4062-81cb-118cd0670fb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:3c:6d', 'vm-uuid': 'e84eec34-b6d0-4d03-9b75-dc12ed1eeab0'}),), if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:11 user nova-compute[72405]: INFO os_vif [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9')
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No VIF found with MAC fa:16:3e:c8:3c:6d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated VIF entry in instance network info cache for port 875df7c0-d9aa-4062-81cb-118cd0670fb3. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG nova.network.neutron [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:10:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-ad1c620a-b677-405c-8ecc-3f75eb08775f req-d4ca4355-beca-40d2-835d-3b931e295c9b service nova] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:10:12 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-8a0a422c-d6c2-4d0b-9b1f-958d5e513dcc req-44fb4cd8-3ec3-41e8-83d8-eb4c724ce506 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8a0a422c-d6c2-4d0b-9b1f-958d5e513dcc req-44fb4cd8-3ec3-41e8-83d8-eb4c724ce506 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8a0a422c-d6c2-4d0b-9b1f-958d5e513dcc req-44fb4cd8-3ec3-41e8-83d8-eb4c724ce506 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-8a0a422c-d6c2-4d0b-9b1f-958d5e513dcc req-44fb4cd8-3ec3-41e8-83d8-eb4c724ce506 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG nova.compute.manager [req-8a0a422c-d6c2-4d0b-9b1f-958d5e513dcc req-44fb4cd8-3ec3-41e8-83d8-eb4c724ce506 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:10:13 user nova-compute[72405]: WARNING nova.compute.manager [req-8a0a422c-d6c2-4d0b-9b1f-958d5e513dcc req-44fb4cd8-3ec3-41e8-83d8-eb4c724ce506 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received unexpected event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with vm_state building and task_state spawning.
Aug 09 00:10:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:13 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539815.1787333, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => Resumed> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] VM Resumed (Lifecycle Event)
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Instance event wait completed in 0 seconds for  {{(pid=72405) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Guest created on hypervisor {{(pid=72405) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Instance spawned successfully.
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Found default for hw_cdrom_bus of ide {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Found default for hw_disk_bus of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Found default for hw_input_bus of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Found default for hw_pointer_model of None {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Found default for hw_video_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Found default for hw_vif_model of virtio {{(pid=72405) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.virt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Emitting event <LifecycleEvent: 1691539815.180219, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => Started> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] VM Started (Lifecycle Event)
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-1142cc0a-2fb8-4f23-91fc-2982e6fe0132 req-f95f0d2d-3b50-4976-8b18-2d13d50b26bd service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1142cc0a-2fb8-4f23-91fc-2982e6fe0132 req-f95f0d2d-3b50-4976-8b18-2d13d50b26bd service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1142cc0a-2fb8-4f23-91fc-2982e6fe0132 req-f95f0d2d-3b50-4976-8b18-2d13d50b26bd service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-1142cc0a-2fb8-4f23-91fc-2982e6fe0132 req-f95f0d2d-3b50-4976-8b18-2d13d50b26bd service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [req-1142cc0a-2fb8-4f23-91fc-2982e6fe0132 req-f95f0d2d-3b50-4976-8b18-2d13d50b26bd service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:10:15 user nova-compute[72405]: WARNING nova.compute.manager [req-1142cc0a-2fb8-4f23-91fc-2982e6fe0132 req-f95f0d2d-3b50-4976-8b18-2d13d50b26bd service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received unexpected event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with vm_state building and task_state spawning.
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72405) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.compute.manager [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Took 6.46 seconds to spawn the instance on the hypervisor.
Aug 09 00:10:15 user nova-compute[72405]: DEBUG nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:10:15 user nova-compute[72405]: INFO nova.compute.manager [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Took 7.18 seconds to build instance.
Aug 09 00:10:15 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-6f939948-991a-4b4b-9142-48b00f54cb17 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.287s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:21 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:10:22 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:10:22 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=25.193523406982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:10:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:10:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:10:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:10:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:11:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:11:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:11:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:11:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:11:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:07 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:07 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:11:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:11:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:11:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:11:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:11:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:11:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:11:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:11:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:11:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:12 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:16 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:11:23 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:11:24 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:11:24 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.148174285888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:11:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:11:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:28 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:11:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:11:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-changed-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:11:59 user nova-compute[72405]: DEBUG nova.compute.manager [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Refreshing instance network info cache due to event network-changed-875df7c0-d9aa-4062-81cb-118cd0670fb3. {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:11:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:11:59 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:11:59 user nova-compute[72405]: DEBUG nova.network.neutron [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Refreshing network info cache for port 875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:12:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:00 user nova-compute[72405]: DEBUG nova.network.neutron [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated VIF entry in instance network info cache for port 875df7c0-d9aa-4062-81cb-118cd0670fb3. {{(pid=72405) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:12:00 user nova-compute[72405]: DEBUG nova.network.neutron [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:12:00 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-c906b2b8-dd37-4f33-b0c7-71a53c281329 req-9d8d6093-1eba-4d6a-a6d3-1a6b2817c391 service nova] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:12:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG nova.objects.instance [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:12:05 user nova-compute[72405]: INFO nova.compute.manager [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attaching volume dc21a1ba-760c-49e8-a45e-34ca4ddf146c to /dev/vdb
Aug 09 00:12:05 user nova-compute[72405]: DEBUG os_brick.utils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3cea0-16b5-4f1a-92f7-bd30c35ef94e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[de240358-13f8-4489-b162-8d6983c22716]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3082067b-5798-4392-b407-8dfc7ba3080d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cdd71b-9cb8-45d5-9bc3-d0b67b8e56a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:12:05 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:12:05 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc647b66-5477-4e27-9422-0455a3e578f5]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG os_brick.utils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:12:05 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating existing volume attachment record: ee57968e-4962-4289-ab76-479750b3439f {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:12:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:06 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:12:08 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:12:09 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:12:09 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:12:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:12:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:12:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:10 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlBNWjof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:12:13 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:12:13 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:12:13 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd9de5-7bbe-48dc-b145-f0dee8799470]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:12:13 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec245d-fba2-4a64-9b55-98af36726937]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c] added
Aug 09 00:12:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d6c250-9327-472f-a57f-e1784473f989]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf23e500-b9de-44be-a867-cea57bce13f8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlBNWjof {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlBNWjof" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0360d6-9aac-4e23-8f67-2cbfc84e6e26]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vlBNWjof'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a8317-24fa-4edb-818f-1909c042eb02]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba92b8a-b1a0-4fe9-8a01-fdbce4296a9a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:12:13 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:12:13 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:12:13 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:12:13 user nova-compute[72405]: 
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[57332f9c-ac18-4a64-a05d-1f5b989cc61d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260]
Aug 09 00:12:13 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260] successful.
Aug 09 00:12:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0251e74-3bcc-420f-afcd-6f0926205075]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e650b-dfde-48e7-9d03-d2c43c37d96c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c (non-flash)
Aug 09 00:12:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c (non-flash)
Aug 09 00:12:13 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d30428-9356-4703-a4ab-467db4d10e59]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlBNWjof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23031303633326430', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031303633326430', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG nova.objects.instance [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:12:14 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:12:14 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:12:14 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:12:14 user nova-compute[72405]:   <serial>dc21a1ba-760c-49e8-a45e-34ca4ddf146c</serial>
Aug 09 00:12:14 user nova-compute[72405]: </disk>
Aug 09 00:12:14 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No VIF found with MAC fa:16:3e:c8:3c:6d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:12:14 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-cbeef40f-7253-4db1-a81c-6f81a695507d tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.665s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:12:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:16 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:20 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.011s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:24 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72405) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:12:25 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.146930694580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:12:25 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:12:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:30 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:12:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:12:38 user nova-compute[72405]: INFO nova.compute.manager [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Detaching volume dc21a1ba-760c-49e8-a45e-34ca4ddf146c
Aug 09 00:12:38 user nova-compute[72405]: INFO nova.virt.block_device [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attempting to driver detach volume dc21a1ba-760c-49e8-a45e-34ca4ddf146c from mountpoint /dev/vdb
Aug 09 00:12:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Attempting to detach device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:12:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:12:38 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:12:38 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:12:38 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:12:38 user nova-compute[72405]:   <serial>dc21a1ba-760c-49e8-a45e-34ca4ddf146c</serial>
Aug 09 00:12:38 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:12:38 user nova-compute[72405]: </disk>
Aug 09 00:12:38 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:12:38 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config.
Aug 09 00:12:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:12:38 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:12:38 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:12:38 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:12:38 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:12:38 user nova-compute[72405]:   <serial>dc21a1ba-760c-49e8-a45e-34ca4ddf146c</serial>
Aug 09 00:12:38 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:12:38 user nova-compute[72405]: </disk>
Aug 09 00:12:38 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691539958.9998348, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:12:39 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config.
Aug 09 00:12:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlBNWjof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:12:39 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[48707360-aa6a-4078-b9ab-0ea3b485c4ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[37646dbf-1e16-40c5-91ea-7e220e841255]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c (non-flash)
Aug 09 00:12:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c (non-flash)
Aug 09 00:12:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdba7be3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a30b19-bd65-432d-9eb9-0b5c2889fa6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f391a-0ba9-4e0b-9c54-6dcc3ebae54c]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[db229fec-86dc-4690-9e49-5949ebc26cc3]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5b73c-0331-4fbf-9260-695c8e3c8655]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c1f24-9427-4f1f-bf90-d8a0997542e5]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a986f0-dab8-4098-85ac-baabc0f3cbe4]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260]
Aug 09 00:12:39 user nova-compute[72405]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c, portal: 172.16.0.220,3260] successful.
Aug 09 00:12:39 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc21a1ba-760c-49e8-a45e-34ca4ddf146c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c5689f-42f5-4162-9b71-4338551ee540]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== disconnect_volume: return (297ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:12:39 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:12:40 user nova-compute[72405]: DEBUG nova.objects.instance [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:12:40 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-e29dc59d-53f2-488b-9573-8f55b0599980 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:12:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:12:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:12:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:13:10 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:13:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:13:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:13:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:13:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:19 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:13:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.146114349365234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:13:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:13:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:13:32 user nova-compute[72405]: INFO nova.compute.manager [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attaching volume ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 to /dev/vdb
Aug 09 00:13:32 user nova-compute[72405]: DEBUG os_brick.utils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[379a6034-1022-4730-a8e0-c0b6b55a3d4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:32 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecdd5a0-75ba-4c3e-bd04-ad221334cd11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d138bd51-9dc2-4e79-80f6-a884eaf100ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ef1a7e-770b-42bd-9a6f-e2a6d4e6d555]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:13:33 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:13:33 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[17007789-5710-465b-a70e-c2bcca256488]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG os_brick.utils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:13:33 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating existing volume attachment record: 99ac649e-2a45-4d0d-ad44-1d063ba12cec {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:13:35 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmijqSwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:13:40 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:13:40 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:13:40 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aba92c-5710-4b5b-9d18-5148c65123f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:13:40 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3fa03-5654-4f25-8cdb-faee52e8d64e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2] added
Aug 09 00:13:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[75baa7c3-829e-42be-abe9-90388a1a42c8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a71260-676f-47ec-a954-d2911d4ea53c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmijqSwN {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmijqSwN" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef3e77-86cf-457f-9229-b86fae2ceb15]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DmijqSwN'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe7aa1-a60b-4272-aee6-9aba99a316b0]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e7113-fb5f-4dd0-b2a3-74b6cc814d34]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:13:40 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:13:40 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:13:40 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:13:40 user nova-compute[72405]: 
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f4175c-d588-4f54-bfd4-44da76c67fd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260]
Aug 09 00:13:40 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260] successful.
Aug 09 00:13:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec2774-ff56-4cee-bd97-0b068b8629bf]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[749ff55d-6ff7-4cf5-9d21-8066b5bace79]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 (non-flash)
Aug 09 00:13:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 (non-flash)
Aug 09 00:13:40 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861c6f1-0e3c-4f3f-b967-0326c7a1052c]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:13:40 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmijqSwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:13:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:13:41 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26131383962366238', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:13:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131383962366238', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:13:41 user nova-compute[72405]: DEBUG nova.objects.instance [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:13:41 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:13:41 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:13:41 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:13:41 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:13:41 user nova-compute[72405]:   <serial>ddf92e7f-6e17-46a2-9b51-c72bcaea14a2</serial>
Aug 09 00:13:41 user nova-compute[72405]: </disk>
Aug 09 00:13:41 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:13:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:13:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:13:42 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No VIF found with MAC fa:16:3e:c8:3c:6d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:13:42 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-f130491b-7295-4b53-8de5-595040a2bd8f tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.538s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:13:44 user nova-compute[72405]: INFO nova.compute.manager [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Detaching volume ddf92e7f-6e17-46a2-9b51-c72bcaea14a2
Aug 09 00:13:44 user nova-compute[72405]: INFO nova.virt.block_device [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attempting to driver detach volume ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 from mountpoint /dev/vdb
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Attempting to detach device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:13:44 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:13:44 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:13:44 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:13:44 user nova-compute[72405]:   <serial>ddf92e7f-6e17-46a2-9b51-c72bcaea14a2</serial>
Aug 09 00:13:44 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:13:44 user nova-compute[72405]: </disk>
Aug 09 00:13:44 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:13:44 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config.
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:13:44 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:13:44 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:13:44 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:13:44 user nova-compute[72405]:   <serial>ddf92e7f-6e17-46a2-9b51-c72bcaea14a2</serial>
Aug 09 00:13:44 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:13:44 user nova-compute[72405]: </disk>
Aug 09 00:13:44 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691540024.6539767, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:13:44 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config.
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmijqSwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:13:44 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a73dbb-9126-462d-86d0-949b7fe4a89f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285d0b5-defd-4fd9-b97e-bfa98e05b030]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 (non-flash)
Aug 09 00:13:44 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 (non-flash)
Aug 09 00:13:44 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb54f1b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[48707d5f-dcc8-4d18-9f81-0258fb7fb9fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57753e-493d-45f3-a17b-282d3f47b2b8]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[275770df-6f21-406f-b93f-610ba271e3e8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a9a2f-d2a8-469d-9bfb-9a5f79fd40fa]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8b1ee-e974-4847-a8bf-ea7c73281975]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3889f24-90bc-4038-b81e-85880424d81d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260]
Aug 09 00:13:44 user nova-compute[72405]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2, portal: 172.16.0.220,3260] successful.
Aug 09 00:13:44 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf92e7f-6e17-46a2-9b51-c72bcaea14a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd056880-990f-4a07-8970-e65e99bdd73a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== disconnect_volume: return (260ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:13:44 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:13:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:45 user nova-compute[72405]: DEBUG nova.objects.instance [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:13:45 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-239dbbcb-e6d8-4b32-af7a-e395bdd17b20 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:13:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:13:58 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:13:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 00:13:58 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] There are 0 instances to clean {{(pid=72405) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 00:14:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:03 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:03 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72405) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 00:14:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:08 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:14:10 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:14:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.14513397216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing inventories for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating ProviderTree inventory for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Updating inventory in ProviderTree for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing aggregate associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, aggregates: None {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Refreshing trait associations for resource provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO {{(pid=72405) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:14:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:14:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG nova.objects.instance [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:14:38 user nova-compute[72405]: INFO nova.compute.manager [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attaching volume 244a928d-d3ec-4e38-a2af-bb99aaa8d831 to /dev/vdb
Aug 09 00:14:38 user nova-compute[72405]: DEBUG os_brick.utils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4422e8-3167-42de-a9f8-f51b1be94600]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056835f-a838-4ded-82b7-693cdf643081]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e932aa2-3d9e-4de0-b197-c6de054a4c0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5d7c7-354f-442d-8bcb-2aa381cf3da3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:14:38 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:14:38 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c522e9a-1896-4102-8e71-22e4decc139b]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG os_brick.utils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:14:38 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating existing volume attachment record: 144944e9-950a-4b90-b2c7-cbfcd5476742 {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:14:40 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HATCpmdU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:14:46 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:14:46 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:14:46 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a8ba1-738d-4b40-9a47-516f7fd23c12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:14:46 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6316ad-2312-4d90-b6c2-9086fc178b07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831] added
Aug 09 00:14:46 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a666c16-81db-4a85-bccd-a7fdcf82de06]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da8f58-32aa-47ad-a230-2aaf96d22b7c]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HATCpmdU {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HATCpmdU" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9ccdff-0ea5-4075-b654-16393e37e6d8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HATCpmdU'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9af3b-a7d3-4725-a8ea-a19a20d27456]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa1fb70-387d-4caf-b74f-13eebd308dd6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:14:46 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:14:46 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:14:46 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:14:46 user nova-compute[72405]: 
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24fdf6c-8c6e-413c-8119-0a6d18b9f7b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260]
Aug 09 00:14:46 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260] successful.
Aug 09 00:14:46 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75b902-bada-4d5a-9554-bd1207cdf4bd]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e3be31-f208-4cdd-943b-10a21bf17085]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 (non-flash)
Aug 09 00:14:46 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 (non-flash)
Aug 09 00:14:46 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cbcab0-2ece-4c1e-b48f-683132758dce]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HATCpmdU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:14:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26437333834623637', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333834623637', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG nova.objects.instance [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:14:47 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:14:47 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:14:47 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:14:47 user nova-compute[72405]:   <serial>244a928d-d3ec-4e38-a2af-bb99aaa8d831</serial>
Aug 09 00:14:47 user nova-compute[72405]: </disk>
Aug 09 00:14:47 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No VIF found with MAC fa:16:3e:c8:3c:6d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:14:47 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-15bdd9d6-22e9-41c1-a623-c8a7cb4e4185 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.468s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:14:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:14:49 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:14:49 user nova-compute[72405]: INFO nova.compute.manager [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Detaching volume 244a928d-d3ec-4e38-a2af-bb99aaa8d831
Aug 09 00:14:50 user nova-compute[72405]: INFO nova.virt.block_device [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attempting to driver detach volume 244a928d-d3ec-4e38-a2af-bb99aaa8d831 from mountpoint /dev/vdb
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Attempting to detach device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:14:50 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:14:50 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:14:50 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:14:50 user nova-compute[72405]:   <serial>244a928d-d3ec-4e38-a2af-bb99aaa8d831</serial>
Aug 09 00:14:50 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:14:50 user nova-compute[72405]: </disk>
Aug 09 00:14:50 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:14:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config.
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:14:50 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:14:50 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:14:50 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:14:50 user nova-compute[72405]:   <serial>244a928d-d3ec-4e38-a2af-bb99aaa8d831</serial>
Aug 09 00:14:50 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:14:50 user nova-compute[72405]: </disk>
Aug 09 00:14:50 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691540090.4468827, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:14:50 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config.
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HATCpmdU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:14:50 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a18d92-46b7-467a-bd98-fbeac543e913]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d918a597-265f-425c-a749-7bb896f2a6bf]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 (non-flash)
Aug 09 00:14:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 (non-flash)
Aug 09 00:14:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781a2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462f04d-04ca-4995-a292-93137505a514]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15e1486-0ad7-4060-88bc-70ef8c0513b1]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e024b-56a3-462f-86cf-96b83f17739f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb1b3d7-6efb-458e-bb67-e473f72f557c]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca9db0c-cc47-4657-9442-1bbf1381b995]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c93089-1fa5-4b8e-85b2-4e5d09bab77c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260]
Aug 09 00:14:50 user nova-compute[72405]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831, portal: 172.16.0.220,3260] successful.
Aug 09 00:14:50 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244a928d-d3ec-4e38-a2af-bb99aaa8d831 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[383ff301-193b-43e8-9a0d-9364481aac8e]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== disconnect_volume: return (254ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:14:50 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:14:51 user nova-compute[72405]: DEBUG nova.objects.instance [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:14:51 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-34e80c62-cc8e-42dd-afdd-3c525a5f6b82 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.523s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:14:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:14:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:15:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:09 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:09 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:15:10 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:15:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:15:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:15:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:15:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:20 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:20 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:15:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:26 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:15:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.144149780273438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:15:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:15:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:15:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG nova.objects.instance [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:15:44 user nova-compute[72405]: INFO nova.compute.manager [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attaching volume 800d4ddb-e1c1-4c71-9436-86522b7a16bc to /dev/vdb
Aug 09 00:15:44 user nova-compute[72405]: DEBUG os_brick.utils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c451379-88fa-47b8-9c74-6ef4f73cd572]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7e3a3b718b\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1528f5a9-8674-4a78-a3a2-c49b359cd513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[193d338c-9873-4545-a499-e9adc617615d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914bad3-b651-453f-8e50-298468f81e1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Running cmd (subprocess): nvme version {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] 'nvme version' failed. Not Retrying. {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.nvmeof [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] nvme not present on system {{(pid=72405) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:15:44 user nova-compute[72405]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:15:44 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604842e-f69d-4563-a569-c6e2d523f342]: (4, '') {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72405) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.lightos [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] LIGHTOS: no hostnqn found. {{(pid=72405) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG os_brick.utils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7e3a3b718b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:15:44 user nova-compute[72405]: DEBUG nova.virt.block_device [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating existing volume attachment record: c2157a86-1511-49c0-a92b-6bc4723e7abc {{(pid=72405) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:15:45 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Calling os-brick to attach iSCSI Volume {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:15:51 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMiwqshc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:15:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:15:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:15:52 user nova-compute[72405]: INFO os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcf51d1-1f01-47a7-8d03-944e12071ad3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:15:52 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --interface default --op new {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5337d86a-f6e9-4ad2-afb7-c111cdfd8a34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc] added\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc] added
Aug 09 00:15:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f6ab4-9f20-4cf2-9d4f-3af2ad3ccea2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ed90b-b95f-4942-9386-e8a35dee308f]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMiwqshc {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMiwqshc" returned: 0 in 0.022s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b999c13-ca10-4351-8d36-94eb4786602b]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMiwqshc'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6448e35-da6f-40de-ad94-8d50571d8de2]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[4540a90b-2684-4cc6-aec1-75be12d76134]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:15:52 user nova-compute[72405]:  {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:15:52 user nova-compute[72405]:  {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:15:52 user nova-compute[72405]: WARNING os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:15:52 user nova-compute[72405]: 
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --login {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef8cda4-9cb4-4c63-827a-25d41470183f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260]
Aug 09 00:15:52 user nova-compute[72405]: Login to [iface: default, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260] successful.
Aug 09 00:15:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5848033f-8806-4cda-8e6c-bcd91bc492a8]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08598d6-d10d-48fd-9a2f-278cb09207e5]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc (non-flash)
Aug 09 00:15:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc (non-flash)
Aug 09 00:15:52 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to 172.16.0.220:3260 {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72405) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72405) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9acea6-e904-4ee8-9c49-6c9329aa7df4]: (4, ('- - 0', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:52 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72405) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMiwqshc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72405) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23562353738323233', 'path': '/dev/sdb'} {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562353738323233', 'path': '/dev/sdb'} {{(pid=72405) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG nova.objects.instance [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:15:53 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:15:53 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:15:53 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:15:53 user nova-compute[72405]:   <serial>800d4ddb-e1c1-4c71-9436-86522b7a16bc</serial>
Aug 09 00:15:53 user nova-compute[72405]: </disk>
Aug 09 00:15:53 user nova-compute[72405]:  {{(pid=72405) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vda, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72405) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] No VIF found with MAC fa:16:3e:c8:3c:6d, not building metadata {{(pid=72405) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:15:53 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-657c1a0e-1815-4cf6-bc89-da54d3f42460 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.545s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:15:55 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:15:55 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:15:55 user nova-compute[72405]: INFO nova.compute.manager [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Detaching volume 800d4ddb-e1c1-4c71-9436-86522b7a16bc
Aug 09 00:15:55 user nova-compute[72405]: INFO nova.virt.block_device [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Attempting to driver detach volume 800d4ddb-e1c1-4c71-9436-86522b7a16bc from mountpoint /dev/vdb
Aug 09 00:15:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Attempting to detach device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config. {{(pid=72405) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:15:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:15:55 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:15:55 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:15:55 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:15:55 user nova-compute[72405]:   <serial>800d4ddb-e1c1-4c71-9436-86522b7a16bc</serial>
Aug 09 00:15:55 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:15:55 user nova-compute[72405]: </disk>
Aug 09 00:15:55 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:15:55 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the persistent domain config.
Aug 09 00:15:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config. {{(pid=72405) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:15:55 user nova-compute[72405]: DEBUG nova.virt.libvirt.guest [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:15:55 user nova-compute[72405]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:15:55 user nova-compute[72405]:   <source dev="/dev/sdb"/>
Aug 09 00:15:55 user nova-compute[72405]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:15:55 user nova-compute[72405]:   <serial>800d4ddb-e1c1-4c71-9436-86522b7a16bc</serial>
Aug 09 00:15:55 user nova-compute[72405]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:15:55 user nova-compute[72405]: </disk>
Aug 09 00:15:55 user nova-compute[72405]:  {{(pid=72405) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-033a6c2d-2072-4cb8-ba2f-70bfb165bd6e None None] Received event <DeviceRemovedEvent: 1691540156.0461621, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72405) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.driver [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:15:56 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully detached device vdb from instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 from the live domain config.
Aug 09 00:15:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] calling os-brick to detach iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdb9822c820>, {'target_iqns': ['iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMiwqshc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:15:56 user nova-compute[72405]: WARNING os_brick.initiator.connectors.base [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc', 0)] {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8279f-dd8f-4206-8d84-397c26eda0c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[56702f2b-fd96-426d-be48-da928c8c10af]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc (non-flash)\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc (non-flash)
Aug 09 00:15:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc (non-flash)
Aug 09 00:15:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb781a1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc'): ({'sdb'}, set())}) {{(pid=72405) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Removing single pathed devices sdb {{(pid=72405) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[7285d1a2-85b1-4557-8be2-52cf49a95f90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8288d-fa0f-4bf1-88e2-382a909c2b2c]: (4, ('ok\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Flushing IO for device /dev/sdb {{(pid=72405) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e5559c-a882-4c97-889c-b6cb2d9fbdf7]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72405) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c90b2-17fd-40c6-a1a6-e933d4f02400]: (4, ('1', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.linuxscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] SCSI volumes sdb have been removed. {{(pid=72405) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc')] {{(pid=72405) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bac8b3-9107-46aa-b59f-45157e58127a]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --logout {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aeee0b-97e2-42e9-953f-55ccc2edb7d0]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260]
Aug 09 00:15:56 user nova-compute[72405]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc, portal: 172.16.0.220,3260] successful.
Aug 09 00:15:56 user nova-compute[72405]:  stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op delete {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:800d4ddb-e1c1-4c71-9436-86522b7a16bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83323) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3178c-519e-48a7-85d9-8662dcdaf801]: (4, ('', '')) {{(pid=83323) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72405) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.base [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG os_brick.initiator.connectors.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] <== disconnect_volume: return (295ms) None {{(pid=72405) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Disconnected iSCSI Volume {{(pid=72405) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:15:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:15:57 user nova-compute[72405]: DEBUG nova.objects.instance [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'flavor' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:15:57 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-930be5fb-0dfb-47c6-acc6-d434d41cb564 tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:16:00 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:16:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:10 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:10 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:16:11 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:16:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:16:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:16:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:16:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:16:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:26 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:16:27 user nova-compute[72405]: DEBUG oslo_concurrency.processutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72405) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:16:28 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:16:28 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.143157958984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72405) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:16:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:16:31 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:36 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:16:41 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:46 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:16:51 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:16:56 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:01 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:06 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:11 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:11 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquired lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Forcefully refreshing network info cache for instance {{(pid=72405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:17:12 user nova-compute[72405]: DEBUG nova.objects.instance [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lazy-loading 'info_cache' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:17:13 user nova-compute[72405]: DEBUG nova.network.neutron [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [{"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:17:13 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Releasing lock "refresh_cache-e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" {{(pid=72405) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:17:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updated the network info_cache for instance {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:17:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:17:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:16 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:17 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:21 user nova-compute[72405]: INFO nova.compute.manager [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Terminating instance
Aug 09 00:17:21 user nova-compute[72405]: DEBUG nova.compute.manager [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Start destroying the instance on the hypervisor. {{(pid=72405) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:21 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e15ee44-4c9a-494d-9874-6f9674315892 req-e5e8a1a7-18e3-4cc7-8ebb-75ef2f8178e1 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-unplugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e15ee44-4c9a-494d-9874-6f9674315892 req-e5e8a1a7-18e3-4cc7-8ebb-75ef2f8178e1 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e15ee44-4c9a-494d-9874-6f9674315892 req-e5e8a1a7-18e3-4cc7-8ebb-75ef2f8178e1 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-2e15ee44-4c9a-494d-9874-6f9674315892 req-e5e8a1a7-18e3-4cc7-8ebb-75ef2f8178e1 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e15ee44-4c9a-494d-9874-6f9674315892 req-e5e8a1a7-18e3-4cc7-8ebb-75ef2f8178e1 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-unplugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.compute.manager [req-2e15ee44-4c9a-494d-9874-6f9674315892 req-e5e8a1a7-18e3-4cc7-8ebb-75ef2f8178e1 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-unplugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Instance destroyed successfully.
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.objects.instance [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lazy-loading 'resources' on Instance uuid e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 {{(pid=72405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.virt.libvirt.vif [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-340831079',display_name='tempest-SnapshotDataIntegrityTests-server-340831079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-340831079',id=52,image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnHKVkCYD2uspbTyB17LYfwjzbwC+qV0XOc6gYJtlW1/GQQHVb7Y7wR5BfKhVgwhqbimsZ3nn1CrcoGcGkQAaIw1OU5PFdoydxOe/3MHzk4ChTtYMvnB69huZtHhC4DwQ==',key_name='tempest-keypair-380181297',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0d7fa8123d4f7cbc98a6fe877dab00',ramdisk_id='',reservation_id='r-6p5h5qy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ed72958c-30b3-4e1d-9bb6-9c0404b96321',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2101868849',owner_user_name='tempest-SnapshotDataIntegrityTests-2101868849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4500f14af8745128d3e1a35aa8d17b8',uuid=e84eec34-b6d0-4d03-9b75-dc12ed1eeab0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Converting VIF {"id": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "address": "fa:16:3e:c8:3c:6d", "network": {"id": "5b3a7f46-d16c-499e-a299-21a1b660e233", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1580104828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0d7fa8123d4f7cbc98a6fe877dab00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875df7c0-d9", "ovs_interfaceid": "875df7c0-d9aa-4062-81cb-118cd0670fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.network.os_vif_util [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9') {{(pid=72405) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG os_vif [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9') {{(pid=72405) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875df7c0-d9, bridge=br-int, if_exists=True) {{(pid=72405) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:22 user nova-compute[72405]: INFO os_vif [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=875df7c0-d9aa-4062-81cb-118cd0670fb3,network=Network(5b3a7f46-d16c-499e-a299-21a1b660e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875df7c0-d9')
Aug 09 00:17:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Deleting instance files /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0_del
Aug 09 00:17:22 user nova-compute[72405]: INFO nova.virt.libvirt.driver [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Deletion of /opt/stack/data/nova/instances/e84eec34-b6d0-4d03-9b75-dc12ed1eeab0_del complete
Aug 09 00:17:22 user nova-compute[72405]: INFO nova.compute.manager [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 00:17:22 user nova-compute[72405]: DEBUG oslo.service.loopingcall [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72405) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.compute.manager [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Deallocating network for instance {{(pid=72405) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] deallocate_for_instance() {{(pid=72405) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:23 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:17:24 user nova-compute[72405]: WARNING nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received unexpected event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with vm_state active and task_state deleting.
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:17:24 user nova-compute[72405]: WARNING nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received unexpected event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with vm_state active and task_state deleting.
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:17:24 user nova-compute[72405]: WARNING nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received unexpected event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with vm_state active and task_state deleting.
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-unplugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-unplugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-unplugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with task_state deleting. {{(pid=72405) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Acquiring lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] No waiting events found dispatching network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:17:24 user nova-compute[72405]: WARNING nova.compute.manager [req-9b798009-f929-45d5-aece-155308e7ac0b req-9c85d108-a311-4720-96cd-36fc4de61804 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received unexpected event network-vif-plugged-875df7c0-d9aa-4062-81cb-118cd0670fb3 for instance with vm_state active and task_state deleting.
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.network.neutron [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Updating instance_info_cache with network_info: [] {{(pid=72405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:17:24 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Took 1.70 seconds to deallocate network for instance.
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: INFO nova.scheduler.client.report [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Deleted allocations for instance e84eec34-b6d0-4d03-9b75-dc12ed1eeab0
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-c3ed1a0b-7a7d-4e37-9fa6-4e8e5858803e tempest-SnapshotDataIntegrityTests-2101868849 tempest-SnapshotDataIntegrityTests-2101868849-project-member] Lock "e84eec34-b6d0-4d03-9b75-dc12ed1eeab0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.903s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:24 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:26 user nova-compute[72405]: DEBUG nova.compute.manager [req-fb90fd90-fa55-4171-a6b7-1ed45222ed71 req-29a5da2c-fb41-4e42-8ac5-8525b4fc68e8 service nova] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Received event network-vif-deleted-875df7c0-d9aa-4062-81cb-118cd0670fb3 {{(pid=72405) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:17:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:17:27 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:17:27 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.17013168334961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:17:27 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:17:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:17:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:17:28 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:17:28 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:17:28 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:17:28 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:17:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691540242.369199, e84eec34-b6d0-4d03-9b75-dc12ed1eeab0 => Stopped> {{(pid=72405) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:17:37 user nova-compute[72405]: INFO nova.compute.manager [-] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] VM Stopped (Lifecycle Event)
Aug 09 00:17:37 user nova-compute[72405]: DEBUG nova.compute.manager [None req-0358bb3f-3d0c-4bb2-91e7-76141b452fb6 None None] [instance: e84eec34-b6d0-4d03-9b75-dc12ed1eeab0] Checking state {{(pid=72405) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72405) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72405) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:17:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:47 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:17:52 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:17:57 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:02 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:18:07 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:18:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:12 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:13 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:13 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72405) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:18:14 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Starting heal instance info cache {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:18:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Rebuilding the list of instances to heal {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:18:14 user nova-compute[72405]: DEBUG nova.compute.manager [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Didn't find any instances for network info cache update. {{(pid=72405) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:18:15 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:15 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:17 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:18 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:19 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:20 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:21 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:22 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:25 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:27 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG oslo_service.periodic_task [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72405) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72405) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:18:29 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:18:29 user nova-compute[72405]: WARNING nova.virt.libvirt.driver [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:18:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=25.16884994506836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72405) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:18:29 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72405) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:18:30 user nova-compute[72405]: DEBUG nova.compute.provider_tree [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed in ProviderTree for provider: 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 {{(pid=72405) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:18:30 user nova-compute[72405]: DEBUG nova.scheduler.client.report [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Inventory has not changed for provider 488a0e0f-53ed-47ef-b1b6-c809d06d6be1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72405) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:18:30 user nova-compute[72405]: DEBUG nova.compute.resource_tracker [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Compute_service record updated for user:user {{(pid=72405) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:18:30 user nova-compute[72405]: DEBUG oslo_concurrency.lockutils [None req-362bbf61-5e2c-4c43-a384-c7e30be120a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72405) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:18:32 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:18:37 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:18:42 user nova-compute[72405]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72405) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}